Google has NO MOAT
[ML News] Geoff Hinton leaves Google | Google has NO MOAT | OpenAI down half a billion (39 min)
OUTLINE: 0:00 – Google I/O 2023: Generative AI in everything 0:20 – Anthropic announces 100k tokens context 0:35 – Intro 1:20 – Geoff Hinton leaves Google 7:00 – Google memo leaked: we have no moat 11:30 – OpenAI loses 540M 12:30 – Google AI: Product first 15:50 – Ilya Sutskever on safety vs competition 18:00 – AI works cannot be copyrighted 19:40 – OpenAI tries to trademark GPT 20:30 – StarCoder: accessible code model 21:40 – RedPyjama & OpenLlama 22:55 – Mosaic 7B model 23:50 – YoloNAS 24:10 – Mojo programming language 25:30 – Random helpful things 37:40 – DeepMind soccer robots
References: https://twitter.com/weirddalle/status… https://www.nytimes.com/2023/05/01/te… https://www.technologyreview.com/2023… https://archive.ph/TrPoH https://twitter.com/DanHendrycks/stat… https://twitter.com/ylecun/status/165… https://twitter.com/home https://twitter.com/ylecun/status/165… https://twitter.com/pkedrosky/status/… https://www.semianalysis.com/p/google… https://twitter.com/untitled01ipynb/m… https://www.theinformation.com/articl… https://archive.ph/bKsdM https://www.washingtonpost.com/techno… https://twitter.com/giffmana/status/1… https://twitter.com/Ken_Goldberg/stat… https://tsdr.uspto.gov/documentviewer… https://twitter.com/osanseviero/statu… https://huggingface.co/bigcode/starcoder https://huggingface.co/spaces/bigcode… https://twitter.com/hardmaru/status/1… https://www.together.xyz/blog/redpaja… https://huggingface.co/togethercomput… https://github.com/openlm-research/op… https://www.mosaicml.com/blog/mpt-7b https://github.com/Deci-AI/super-grad… https://www.modular.com/mojo https://www.aicrowd.com/challenges/ha… https://learnprompting.org/ https://developer.nvidia.com/blog/nvi… https://blogs.nvidia.com/blog/2023/04… https://lmql.ai/#distribution https://github.com/gventuri/pandas-ai… https://lamini.ai/blog/introducing-la… https://github.com/deep-floyd/IF https://huggingface.co/spaces/DeepFlo… https://twitter.com/FaramaFound/statu… https://txt.cohere.com/embedding-arch… https://arxiv.org/abs/2304.12210 https://github.com/h2oai/h2ogpt https://huggingface.co/h2oai/h2ogpt-o… https://github.com/h2oai/h2o-llmstudio https://ai.facebook.com/blog/ai-datas… https://www.camel-ai.org/ https://github.com/lightaime/camel?ut… https://huggingface.co/Writer/camel-5… https://laion.ai/blog/paella/ https://magazine.sebastianraschka.com… https://pickapic.io/ https://github.com/yuvalkirstain/hero… https://huggingface.co/datasets/yuval… https://future.snorkel.ai/poster-cont… https://twitter.com/d_feldman/status/… https://twitter.com/DeepMind/status/1… https://arxiv.org/abs/2304.13653 https://twitter.com/SmokeAwayyy/statu…