🌀

Categories of Innovation

  • Categories of Innovation
  • LLM's
  • Robotics - How Technology in the real world will change
  • Creative Tools
  • Other Science
  • Industry

LLM's

  • Comparing the different chatbots, what each of them offer in the present
    • Speed of adoption (87)
    • Key Vocab around Chatbots - RLHF
    • How they progressed over the past year.
    • How the competition is steepening and the key players are no longer open (Besides Meta)
    • Talk about the major companies involved in the AI movement
      • OpenAI
      • Anthropic
      • Google
      • Meta
      • Pi
  • How these LLM’s are likely to improve, and what this would mean from a practical standpoint
    • Context Windows don’t do well in the middle right now (24)
    • They will become more indistinguishable… so they will build in watermarks (Talk about previous failures)

Robotics - How Technology in the real world will change (45ish)

  • PaLM-E: a foundation model for robotics
  • From vision-language models to low-level robot control: RT-2
  • From vision-language models to low-level robot control: RoboCat
  • An autonomous system that races drones faster than human world champions
  • The emergence of maps in the memories of blind navigation agents
  • CICERO masters natural language to beat humans at Diplomacy

Creative Tools (51)

  • The text-to-video generation race continues
  • Instruction based editing assistants for text-image generation
  • Welcome 3D Gaussian Splatting
  • NeRFs meet GenAI
  • Zero-shot metric depth is here
  • Segment Anything: a promptable segmentation model with zero-shot generalisation
  • DINOv2: the new default computer vision backbone
  • Another year of progress in music generation

Other Science

  • More accurate weather predictions, in the now(casts) and the longer ranges (58
  • Diffusion models design diverse functional proteins from simple molecular specifications (60)
  • Learning the rules of protein structure at evolutionary-scale with language models
  • Predicting the outcome of perturbing multiple genes without a cell-based experiment
  • Pathogenic or not? Predicting the outcome of all single-amino acid changes
  • Google’s Med-PaLM 2 language model is an expert according to the USMLE
  • Real world-inspired clinical system design for automated medical image analysis

Industry

  • NVIDIA is murdering, absolutely crushing and quickly becoming one of the most powerful companies in the world
  • Text to Speech blew up in popularity
  • Synthesia Video growth - and can talk about innovations in this AI avatar space (86)
  • Chegg got absolutely destroyed by AI
  • ChatGPT being adopting for coding - Chart showing the comparison to github and stack overflow
  • Github Co-Pilot
  • Character AI, Copyright issues, and emotional dependence on these chatbots
  • Midjourney growth
  • Apps are struggling with retention (95)
  • Copyright protection in AI generated content (98)
  • Hugging Face - Open source AI is on a tear at a time when incumbents push for closed source AI (101)
  • Insane bubble might be forming - On the day of NVIDIA’s $50M investment announcement into Recursion Pharmaceuticals, the latter’s share price surged 80% to create an additional $1B of market value. Such a reaction demonstrates the AI fever. (104)
  • Google Deepmind version 2 forming
  • Amazon Investment in Anthropic
  • Waymo and Cruise have been granted permission to launch paid 24/7 autonomous driving services in San Francisco. Previously paid rides were only possible when a driver was in the vehicle for monitoring.
  • Countries investing in AI unicorns by country (113)
  • 24% of all corporate VC investments went into AI companies in 2023 (116)
  • 2023 sees a massive acceleration in GenAI funding (117)
Â