The Year In AI So Far: Massive Models And How To Use Them

Republished By Plato

Followers: 0

The world of artificial intelligence and machine learning moves very fast. So fast, in fact, that it’s remarkable to think that it was only a decade ago when the AlexNet model dominated the ImageNet competition and kicked off the process that made deep learning a bona fide technology movement. Today, after years of headlines about game-playing, we see ever-increasing innovation that applies to the real world.

In the last couple of years alone, AI/ML models like GPT-3 and AlphaFold delivered capabilities that catalyzed new products and companies, and that stretched our understanding of what computers can do.

With that in mind, we thought we’d revisit our AI/ML coverage in Future over the first half of the year, as well as catch you up on some — but certainly not all — of the major industry developments during that time. As you’ll see, some combination of large language models, generative models, and foundation models are a major source of attention, and we’re just skimming the surface in terms of understanding what they can do and how the world outside of large research labs can utilize their power.

The Future focus: How to take advantage of AI/ML advances

How to Use Massive AI Models (Like GPT-3) in Your Startup by Elliot Turner / Hyperia

AlphaFold, GPT-3 and How to Augment Intelligence with AI by Niko Grupen / Cornell

AlphaFold, GPT-3 and How to Augment Intelligence with AI (Pt. 2) by Niko Grupen / Cornell

Data50: The World’s Top Data Startups by Jennifer Li, Sarah Wang, and Jamie Sullivan / a16z

Emerging Architectures for Modern Data Infrastructure by Matt Bornstein, Jennifer Li, and Martin Casado / a16z

A Decade of Deep Learning: How the AI Startup Experience Has Evolved with Richard Socher (Q&A) / you.com

7 Techniques for Building Reliable AI Models by Beena Ammanath (book excerpt) /Deloitte

The Two Things We’ll Need for the Next AlphaFold with Daphne Koller (Q&A) / Insitro

Industry focus: Images, words, and more coding

Competitive Programming with AlphaCode / Deepmind

Teaching AI to Translate 100s of Spoken and Written Languages in Real Time / Meta AI

Pathways Language Model (PaLM): Scaling to 540 Billion Parameters for Breakthrough Performance / Google Research

DALL-E 2 / OpenAI

Imagen: Text-to-Image Diffusion Models / Google Research

These types of advances, and the increased understanding of how to utilize them, are why we’re dedicated to stepping up our coverage of AI/ML and, in particular, how we’ll see it applied in real-world settings over the next few years. From biotechnology to television, we’re poised for a serious reimagining of what’s possible and how software can help humans deliver on their wildest ideas. If you’re working on something exciting and novel in the AI/ML space and want to share your thoughts on where we’re headed, please send us a pitch.

Posted June 27, 2022

Technology, innovation, and the future, as told by those building it.

Thanks for signing up.

Check your inbox for a welcome note.

Views expressed in “posts” (including articles, podcasts, videos, and social media) are those of the individuals quoted therein and are not necessarily the views of AH Capital Management, L.L.C. (“a16z”) or its respective affiliates. Certain information contained in here has been obtained from third-party sources, including from portfolio companies of funds managed by a16z. While taken from sources believed to be reliable, a16z has not independently verified such information and makes no representations about the enduring accuracy of the information or its appropriateness for a given situation.

This content is provided for informational purposes only, and should not be relied upon as legal, business, investment, or tax advice. You should consult your own advisers as to those matters. References to any securities or digital assets are for illustrative purposes only, and do not constitute an investment recommendation or offer to provide investment advisory services. Furthermore, this content is not directed at nor intended for use by any investors or prospective investors, and may not under any circumstances be relied upon when making a decision to invest in any fund managed by a16z. (An offering to invest in an a16z fund will be made only by the private placement memorandum, subscription agreement, and other relevant documentation of any such fund and should be read in their entirety.) Any investments or portfolio companies mentioned, referred to, or described are not representative of all investments in vehicles managed by a16z, and there can be no assurance that the investments will be profitable or that other investments made in the future will have similar characteristics or results. A list of investments made by funds managed by Andreessen Horowitz (excluding investments for which the issuer has not provided permission for a16z to disclose publicly as well as unannounced investments in publicly traded digital assets) is available at https://a16z.com/investments/.

Charts and graphs provided within are for informational purposes solely and should not be relied upon when making any investment decision. Past performance is not indicative of future results. The content speaks only as of the date indicated. Any projections, estimates, forecasts, targets, prospects, and/or opinions expressed in these materials are subject to change without notice and may differ or be contrary to opinions expressed by others. Please see https://a16z.com/disclosures for additional important information.

Time Stamp: June 27, 2022July 16, 2022