AI Learns By Watching Videos

Author

AI Breakfast
June 12, 2024

Good morning. It’s Wednesday, June 12th.

Today in Tech History: 15 years ago today, most full-power analog TV broadcasts in the United States officially ceased transmission, as apart of the analog to digital transition.

In today’s email:

  • AI Learns Languages by Watching

  • Apple AI Announcement Recap

  • Is Your Apple Data Safe?

  • 10 New AI Tools

  • Latest AI Research Papers

You read. We listen. Let us know what you think by replying to this email.

Today’s trending AI news stories

New AI Algorithm Discovers Language Just By Watching Videos

Mark Hamilton, an MIT Ph.D. student, has developed DenseAV, an algorithm that learns language solely by associating audio and video signals. Inspired by scenes from "March of the Penguins," Hamilton sought to create a system capable of understanding human language "from scratch." DenseAV learns language by predicting audio from video and vice versa, identifying objects based on auditory cues. Through training, the algorithm identifies relevant pixels in video streams corresponding to spoken words.

Interestingly, it distinguishes between words and sounds, exhibiting a nuanced understanding of language. This self-supervised approach, detailed in this research, holds promise for various applications, including instructional video analysis and decoding non-written languages like dolphin communication. Read more.

All of Apple’s big AI news from WWDC 2024

Apple’s WWDC 2024 event dropped a dozen major announcements, with AI taking center stage.

First, Apple introduced its new AI system, Apple Intelligence, for iPhone, iPad, and Mac. This offering leverages generative models with user data to enhance writing, image creation, and Siri functionality. On-device processing prioritizes user privacy for basic AI tasks, with dedicated servers handling complex queries.

Siri received a context-aware upgrade (currently U.S. English beta), allowing it to fetch flight details or interact with app content and leveraging LLMs for improved understanding. Siri will integrate with OpenAI’s ChatGPT, enabling more dynamic query handling. Apple also rolled out AI features across Mail, Messages, Photos, and other apps, including email summarization, custom emoji creation, and AI-powered image cleanup.

iOS 18 brings customization galore with a revamped Control Center, app locking, RCS messaging, and even satellite SMS. Apple TV+ gains "inSight" for media identification, while a new Passwords app manages logins.

iPadOS 18 welcomes a long-awaited Calculator app with Apple Pencil support, while macOS 15 allows iPhone mirroring for enhanced multitasking. The health-focused watchOS 11 personalizes widgets and adds new tracking features. VisionOS 2 upgrades the Vision Pro with spatial photos, an ultrawide Mac display, gesture controls, and travel mode.

And last but not least, the next AirPods Pro update lets you nod or shake your head to interact with Siri, while also improving voice quality with Voice Isolation.

Apple’s AI Promise: “Your data is never stored or made accessible to Apple”

Apple's "Apple Intelligence" incorporates a new "Private Cloud Compute" feature to safeguard user data processed on cloud servers. Craig Federighi, SVP for Software Engineering emphasized on-device processing for enhanced privacy, leveraging A17+ and M-series chips for executing generative AI models locally.

In instances requiring cloud processing, Apple's dedicated servers, powered by proprietary silicon, employ Swift's intrinsic security tools to ensure data integrity. Federighi underscored that only pertinent data is transmitted, with no storage or accessibility to Apple, prioritizing user privacy.

Enhancing transparency, Apple plans to publicly release the server code for independent validation. While specifics were scant, the keynote underscored Apple's commitment to privacy and security as it ventures into generative AI. Independent scrutiny of the server code in the future will validate these assurances.

In related news, Elon Musk voiced concerns over Apple's integration of OpenAI, threatening to ban iPhones from his companies. Musk's objections revolve around potential data exposure, contrasting with Apple's assurances of user consent and privacy protection. Read more.

Etcetera: Stories you may have missed

10 new AI-powered tools from around the web

TeamCreate.ai offers AI workers for diverse roles like sales, finance, and marketing. Deploy via Slack, integrate 200+ apps, and assign tasks.

Autodesigner 2.0 merges ChatGPT conversational flow with Uizard UI generator, simplifying UI design into digital products effortlessly in minutes.

Review Raven by Blursday offers instant AI-powered feedback on Figma design screens, enhancing workflow efficiency and ensuring design consistency.

Evalify uses AI to analyze global patents, offering IP risk assessments for tech startups and investors, enhancing decision-making processes.

Prog.AI is a Chrome extension that provides recruiters with detailed insights on software engineers from LinkedIn and GitHub, scoring skills based on actual code contributions.

Dynamic UI by Quest Labs AI customizes app interfaces per user via in-app SDKs, empowering growth and marketing teams with AI-driven personalization.

Jogg.ai transforms URLs into engaging video ads using AI and templates, enabling quick and effortless creation of high-quality video content for marketing.

EducUp uses AI to turn any idea, video, website, PDF, or text into gamified lessons, optimizing personalized learning paths quickly.

SynthMind.app is an AI client discovery tool that identifies potential clients based on your business needs, delivering leads directly to your inbox daily.

Afforai is an AI-integrated reference manager that streamlines research by managing, annotating, and citing papers, and conducting literature reviews efficiently.

arXiv is a free online library where researchers share pre-publication papers.

Thank you for reading today’s edition.

Your feedback is valuable. Respond to this email and tell us how you think we could add more value to this newsletter.

Interested in reaching smart readers like you? To become an AI Breakfast sponsor, apply here.