Tech

Former OpenAI researcher’s new firm will train you learn how to construct an LLM


File photo of children in a classroom listening to a robot.

On Tuesday, former OpenAI researcher Andrej Karpathy announced the formation of a brand new AI studying platform referred to as Eureka Labs. The enterprise goals to create an “AI native” academic expertise, with its first providing targeted on instructing college students learn how to construct their very own massive language mannequin (LLM).

“It is nonetheless early days however I wished to announce the corporate in order that I can construct publicly as a substitute of conserving a secret that is not,” Karpathy wrote on X.

Whereas the thought of utilizing AI in training is not significantly new, Karpathy’s method hopes to pair expert-designed course supplies with an AI-powered instructing assistant primarily based on an LLM, aiming to supply customized steering at scale. This mixture seeks to make high-quality training extra accessible to a world viewers.

The platform’s inaugural course, LLM101n, targets an undergraduate-level viewers. It’ll stroll college students via the method of coaching an AI system referred to as a “Storyteller AI Giant Language Mannequin” that can “create, refine and illustrate little tales.” Eureka Labs will supply this course on-line at first, then via in-person teams sooner or later.

Karpathy no stranger to AI training

Andrej Karpathy, then director of AI Tesla, speaks at the Train AI conference at Pier 27 in San Francisco in 2018.
Enlarge / Andrej Karpathy, then director of AI Tesla, speaks on the Prepare AI convention at Pier 27 in San Francisco in 2018.

Karpathy’s roots in AI go deep. In 2015, he obtained a PhD from Stanford College below laptop scientist Dr. Fei-Fei Li. He was one of many founding members of OpenAI as a analysis scientist, then moved to Tesla to change into its senior director of AI between 2017 and 2022. In 2023, Karpathy rejoined OpenAI for a 12 months, departing in February.

This new enterprise builds on Karpathy’s observe file of AI training. Over the previous 12 months, Karpathy has posted several highly regarded tutorials protecting AI ideas on YouTube, together with an tutorial video about learn how to build an LLM from scratch, which at present has 405 million views. The movies have showcased his means to interrupt down complicated subjects for a broader viewers.

“@EurekaLabsAI is the fruits of my ardour in each AI and training over ~2 a long time,” Karpathy wrote on X. “My curiosity in training took me from YouTube tutorials on Rubik’s cubes to beginning CS231n at Stanford, to my newer Zero-to-Hero AI sequence. Whereas my work in AI took me from educational analysis at Stanford to real-world merchandise at Tesla and AGI analysis at OpenAI. All of my work combining the 2 up to now has solely been part-time, as aspect quests to my ‘actual job,’ so I’m fairly excited to dive in and construct one thing nice, professionally and full-time.”

Eureka Labs’ imaginative and prescient extends past its preliminary AI course, hinting at a broader curriculum that might span numerous topics. “Right this moment, we’re heads down constructing LLM101n,” the announcement reads, “however we look ahead to a future the place AI is a key know-how for growing human potential. What would you prefer to study?



Source

Related Articles

Leave a Reply

Your email address will not be published. Required fields are marked *

Back to top button