AI Valley
Posts
OpenAI speeds up GPT-4o by 5 times

OpenAI speeds up GPT-4o by 5 times

PLUS: AI Startups to Watch in 2024

Barsee
06 Nov

_{Sign up}_|_{Follow us on X}_|_Sponsor

Together with

Howdy! It’s Barsee again.

Happy Wednesday, AI family, and welcome back to AI Valley.

In today’s edition:

GPT-4o just learned how to skip the line 🏃‍♂️
AI Startups to Watch in 2024 👀
Hertz-dev just made AI talk like a human 🎧💬
Plus trending AI tools, posts, and resources 🤖

Ready, set, go…

OPENAI

GPT-4o just learned how to skip the line 🏃‍♂️

Benchmark

OpenAI has introduced the "Predicted Outputs" feature, which significantly reduces the latency of GPT-4o and GPT-4o-mini by providing reference strings to speed up processing.

Here's what you need to know:

The "Predicted Outputs" feature uses speculative decoding to skip predictable content, allowing the model to focus only on parts that need computation and making processing much faster.
By passing in existing content as a prediction, developers can regenerate text more quickly and efficiently, which is ideal for repetitive updates.
This reduces the model's workload, delivering up to a 5x faster response time for tasks like document updates and code editing without compromising accuracy.
In particular, code editing with GPT-4 now sees response times 2-4x faster, with large file edits reduced from around 70 seconds to just 20 seconds.

Why it matters:

This feature speeds up LLM responses, making interactions smoother and reducing the cost of running complex tasks, which is a big win for developers and users alike.

TOGETHER WITH SYNCLY

Use AI to gather and analyze customer feedback in real time 🤖

Syncly

Syncly (YC W23) turns daily customer feedback into actionable product and operations insights, giving you full visibility into your customers’ journey and proactively addressing issues before customers churn.

With Syncly, you can:

All feedback from multiple sources in one place: Syncly integrates seamlessly with your CX tech stack, even aggregating app reviews, surveys, calls, and more.
Dynamic Sentiment Analysis: Syncly tracks customers' sentiments from their feedback, allowing you to take timely actions before they escalate.
VoC Report Automation: No more manual tagging and Excel marathons. Syncly automates VoC reports with powerful charts and dashboard features.
AI Search: Ask Syncly AI to answer critical business questions and get a concise overview of customer feedback from everyday queries.

Try Syncly for free and transform customer feedback into success.

STARTUPS

AI Startups to Watch in 2024 👀

Every year, new startups pull to the forefront of their industry through exciting innovation, tech, and industry-disrupting business models. We’ve rounded up the top AI startups of 2024 that startup lovers, investors, and aspiring entrepreneurs should follow.

Abridge - Transcribes patient-doctor interactions, integrating with electronic health records to help manage healthcare labor shortages.
Air Space Intelligence - AI for aerospace, aiding air operations in decision-making, and expanding its reach in U.S. defense.
AliveCor - Offers remote heart health management with FDA-approved AI, detecting 35 heart conditions using a pocket-sized ECG device.
Braintrust - Provides an infrastructure stack for enterprise AI, boosting accuracy and supporting major tech companies.
Cake AI - Integrated platform with AI tools for building and managing AI infrastructure, aimed at easy deployment.
Clay - AI-driven sales and marketing tool, streamlining outreach and data enrichment for go-to-market teams.
Cranium - Security and compliance for generative AI, spun out of KPMG, enabling organizations to secure their AI systems.
Connect the Dots - AI-based relationship management platform for sales, mapping warm introductions within networks.
Continua AI - "Always-on" personal AI assistants enhancing productivity, created by a former Google engineer.
Cove - AI-driven coworking spaces focused on collaboration, founded by a team from Meta’s trust and safety division.
Datology - Helps companies curate high-quality data for AI model training, crucial for efficient model development.
Datavolo - Enables generative AI models to access unstructured data, creating secure, multimodal data pipelines.
Decagon - AI agents for customer support that learn from workflows and data sources, enhancing enterprise support.
Distributional - Automates AI testing to ensure safe, reliable AI systems for enterprises.
Enveda Biosciences - Uses AI to discover new drugs from plants, advancing multiple drug candidates to clinical trials.
Ezra - AI-powered MRI scan analysis for early detection of health conditions, aiming to make preventive care more accessible.
Finally - AI-based bookkeeping for SMBs, rapidly gaining traction and positioned as a comprehensive solution for financial management.
Gamma - Enterprise AI tool for content creation, allowing businesses to create presentations and documents efficiently.
Glean - AI platform for managing a company’s data with privacy and security, delivering a ChatGPT-like experience.
Greenlite - Compliance automation for fintechs and banks using AI, reducing human error and improving efficiency.
Haize Labs - Automated stress testing for large language models, ensuring secure and robust AI systems.
HeyGen - Generative AI for video creation, enabling personalized video content at scale.
Intenseye - Computer vision-based AI for workplace safety, processing billions of images to prevent accidents.
InWorld AI - AI for gaming, enhancing gaming experiences with partnerships across major platforms.
Langchain - Aids developers in building LLM-powered apps, widely adopted by developers with significant community support.
Lyric - AI decision-making tools for supply chain management, making AI accessible for complex logistics operations.
Modal - Cloud platform for deploying AI code and LLMs, reducing infrastructure needs for companies like Ramp and Substack.
Modular - Streamlines AI system deployment, offering a fast, efficient framework for generative AI applications.
Mutiny - AI-driven sales and marketing platform for account-based marketing, helping B2B companies personalize outreach.
Norm AI - Compliance tool using generative AI for regulatory risk management, a solution for chief compliance officers.
Nox - Personalized AI assistant aiming to enhance productivity and task management.
Overland AI - Autonomous navigation software for off-road vehicles, particularly for defense applications.
Protect AI - Comprehensive security platform for AI and ML, safeguarding AI projects against potential risks.
Sakana AI - AI research lab working on nature-inspired intelligence, with roots in Google AI research.

AI VOICE

Hertz-dev just made AI talk like a human 🎧💬

Hertz-dev

Standard Intelligence launches Hertz-dev, an open-source AI model for generating high-quality conversational audio with natural speech and low latency.

Here's what you need to know:

This AI voice model comes with 8.5 billion parameters and was trained on 20 million hours of high-quality audio, enabling real-time, bi-directional conversations.
It captures subtle aspects of human speech, such as pauses and emotional tones, by leveraging real-world dialogue data.
The base model can be fine-tuned for tasks like live translation, audio classification, and conversational modeling.
Currently, in a 70B parameter version, Hertz-dev is released under the Apache license with code and checkpoints, with plans for multi-modal expansion.

Why it matters:

It gives developers access to a powerful open-source tool they can customize for various voice applications, like improving customer service robots or creating smarter voice assistants.

BREAKING BYTES

NVIDIA has overtaken Apple as the world’s most valuable company, reaching a market cap of $3.43 trillion. Apple follows at $3.38 trillion, with Microsoft at $3.06 trillion (View Market Cap)

CampaniesMarketCap

Hume debuts an AI companion app that combines the EVI 2 voice model with Claude 3.5 to offer emotionally intelligent conversations and guidance (View post)
Osmo achieves a scent teleportation breakthrough, successfully analyzing and recreating a plum's exact smell using AI and molecular mapping (2 minutes read)
Caitlin Kalinowski, former head of Meta's AR glasses project, has joined OpenAI to lead its new robotics and consumer hardware team. She might also collaborate with ex-Apple executive Jony Ive on OpenAI's new AI hardware project (View post)
Apple will provide limited free ChatGPT access via Siri, with an option to upgrade. iOS 18.2 beta 2 includes a daily limit for GPT-4o and DALL-E 3, with full AI integration launching in December (1 minute read)

MacRumors

TRENDING TOOLS

Zero Setup AI Coding with OpenHands > Cloud VS Code meets autonomous AI coding, powered by Daytona. (link)
NoteThisDown > Handwritten notes to Notion. (link)
RD-TableBench > Evaluates extraction performance from complex tables, including scanned, handwritten, and merged cells. (link)
Lunchgun > Aggregating and analyzing the public data of product launches on Product Hunt. (link)

COOL FINDINGS / RESOURCES

I took a ‘decision holiday’ and put AI in charge of my life. (link)
Build a multi-agent app with OpenAI swarm and Llama 3.2 running locally on your computer. (link)
How to use Google Drive with ChatGPT. (link)
ChatGPT Search is not OpenAI’s ‘Google killer’ yet. (link)