Vellum download the new12/28/2023 If the LLM was going to answer the query, the model should then - we’re extending the example here on our own - be able to correctly do so without hallucinating or going off the rails. It first needed a prompt that worked as an escalation classifier to decide if the question should be answered by a person or the LLM. This company wanted to build an LLM agent of sorts that could answer questions like, “Can you make a reservation for me?” To explain, Sharma pointed to a support ticketing software company that targets hotels. How do companies use refined prompts in applications that require prompt engineering to ensure their outputs are well-tuned? On that topic, Vellum offers a way for AI prompters to compare model output side-by-side, the ability to search for company-specific data to add context to particular prompts, and other tools like testing and version control that companies may like in order to ensure that their prompts are spitting out correct stuff.īut how hard can it be to prompt an LLM? Sharma said, “It is simple to spin up an LLM-powered prototype and launch it, but when companies end up taking something like to production, they realize that there are many edge cases that come up, which tend to provide weird results.” In short, if companies want their LLMs to be good consistently, they will need to do more work than simply skin GPT outputs sourced from user queries. ![]() More power in more hands means greater demand for tooling. Sharma told me that until the release of recently released LLMs “it was never possible to use natural language to get results from an AI model.” The shift to accepting natural language inputs “makes the market a lot bigger because you can have a product manager or a software engineer literally anyone be a prompt engineer.” Seeing a market open up new opportunities to build tooling is not novel, but modern LLMs may not only change the AI market itself, they could also make it larger. Thanks to that experience and the machine learning operations background of his two co-founders, when ChatGPT was released last year, they realized the market demand for tooling to make generative AI prompting better was “going to grow exponentially.” Hence, Vellum. That meant the team was spending engineering time on internal tooling instead of building for the end user. The sheer amount of work by hand was adding up, Sharma said. ![]() They therefore needed to build tooling for fine-tuning and semantic search as well. While at Dover, they built generative AI applications to write recruiting emails, job descriptions and the like, but they noticed that they were spending too much time on their prompts and couldn’t version the prompts in production, nor measure their quality. Sharma told me he and his co-founders (Noa Flaherty and Sidd Seethepalli) were employees at Dover, another Y Combinator company from the 2019-era, working with GPT 3 in early 2020 when its beta was released. However, as we’re discussing something a little bit nascent, let’s take our time to talk about prompt engineering more generally. Normally in a short funding update of this sort, I’d spend a little time detailing the company and its product, focus on growth and scoot along. Our favorite startups from YC’s Winter 2023 Demo Day - Part 2 According to Akash Sharma, Vellum’s CEO and co-founder, the startup has 40 paying customers today, with revenue increasing by around 25% to 30% per month.įor a company born in January of this year, that’s impressive. Given the number of generative AI models, how quickly they are progressing and how many business categories appear ready to leverage large language models (LLMs), we liked its focus.Īccording to metrics that Vellum shared with TechCrunch, the market also likes what the startup is building. The startup first caught TechCrunch’s eye during Y Combinator’s most recent demo day (Winter 2023) thanks to its focus on helping companies improve their generative AI prompting. ![]() The company declined to share who its lead investor was for the round apart from noting that it was a multistage firm, but it did tell TechCrunch that Rebel Fund, Eastlink Capital, Pioneer Fund, Y Combinator and several angels took part in the round. This morning, Vellum.ai said it had closed a $5 million seed round.
0 Comments
Leave a Reply.AuthorWrite something about yourself. No need to be fancy, just an overview. ArchivesCategories |