Google's Latest Research Can Make Static Photos Interactive or Turn Them Into Videos
Applications include turning still images into seamlessly looping dynamic videos, or allowing users to realistically interact with objects in photos.
Research
A collection of our articles covering the latest in AI research. Get comprehensive analyses and insights into the cutting-edge AI models and breakthroughs from leading tech companies and research labs.
Microsoft Proposes InstructDiffusion for Unified Computer Vision Modeling
The model offers a promising concept for developing adaptable, generalist vision models. By mimicking how humans process images, it points towards more universal and flexible AI to handle diverse vision challenges.
Falcon 180B: A New Leader in Open LLMs Emerges
It outperforms Llama 2, demonstrates abilities on par with closed models like PaLM 2 Large (despite being just half its size), and ranks just below GPT-4.
Meta Releases BELEBELE, A Multilingual AI Benchmark Spanning 122 Languages
BELEBELE represents the largest parallel multilingual benchmark ever created specifically for reading comprehension.
Embracing Open Source and Equity: Meta Announces Commercial Relicensing of DINOv2 and Introduction of FACET
By opening up DINOv2 under a more permissive license and introducing FACET for fairness benchmarking, Meta is setting a positive example for responsible AI development.
Researchers Used AI to Give a Paralyzed Woman Her Voice Back
Not only does the implant use Ann's brain signals to generate speech, but it also animates a digital avatar with facial expressions, mimicking the natural nuances of human communication.
Google Researchers Teach Robots New Skills With Just Natural Language
This study could herald a new era in robotics, enabling anyone to easily teach robots an array of new skills simply by explaining it to them.
Meta Unveils SeamlessM4T for Near Universal Speech Translation
The project represents Meta's endeavor to create a unified multilingual system capable of catering to all language translation needs.
Allen Institute Unveils Dolma, Largest Open Training Dataset for Large Language Models
Dolma is significantly larger than other open datasets and is released under AI2’s impact license, which was designed to balance ease of access with mitigation of potential risk in distributing large datasets.
Humans in 4D: Tracking People in 3D Over Time Using Transformers
New research from Berkely present an approach that, given any video in the wild, can jointly reconstruct the underlying humans in 3D, and track them over time.
Google is Using AI to Reduce the Climate Impact of Contrails
Working with American Airlines, and Breakthrough Energy, Google Research was able to reduce contrails by 54% compared to typical flight paths.
Project Rumi: Augmenting AI Understanding Through Multimodal Paralinguistic Prompting
New research from Microsoft aims to help AI understand non-verbal cues like facial expressions, tone of voice, gestures, and more
Meta Open Sources AudioCraft
The company says responsible innovation can’t happen in isolation. By open sourcing its research and resulting models, it hopes to ensure that everyone has equal access.
Seeing Through Darkness: Purdue Researchers Unveil AI Thermal Imaging Technology
Improving upon traditional machine vision and perception, this method is designed to help machines perceive and interact with their surroundings in ways that were previously unthinkable.
RLHF In the Spotlight: Problems and Limitations with Key AI Alignment Technique
A new paper takes a closer look at serious open challenges related to RLHF, and emphasizes that relying solely on it for AI alignment is profoundly risky
Med-PaLM M is a Multimodal Biomedical AI from Google Research and Google DeepMind
Across all tasks in the benchmark, Med-PaLM M reached or exceeded state-of-the-art performance, often surpassing specialized models optimized for individual tasks by a wide margin.
“Sure, I’ll Help You Build a Bomb”: New Research Reveals Alarming Gaps in AI Safety
The new class of adversarial attacks are capable of circumventing the alignment measures designed to prevent the generation of inappropriate or harmful content in multiple LLMs.
Google DeepMind Unveils RT-2, Bringing Robots Closer to General Intelligence
Essentially, the model can comprehend and 'speak robot', translating abstract concepts learned from vast web data into actionable knowledge that informs robot behavior.
Meta Releases Open Catalyst Demo to Help Discover Catalysts Faster With AI
The research represents a potential game-changer for material science, enabling catalyst simulations at unprecedented speeds and scales.
Highlights from Apple's Natural Language Understanding Workshop 2023
Topics covered included privacy preservation, knowledge grounding, multimodal understanding, and controlled synthetic data generation.
Meta Unveils CM3leon: A Breakthrough AI Model for Advanced Text-to-Image Generation and Image Understanding
With its versatile capabilities and improved performance, CM3leon represents a significant step towards higher-fidelity image generation and understanding, paving the way for enhanced creativity and applications in the metaverse.
Toyota Unveils New Generative AI Technique to Streamline Vehicle Design
The novel technique facilitates the inclusion of preliminary design blueprints as well as engineering limitations when generating design concepts.
Take a listen to Voicebox, Meta's new generative AI for speech
This new model is a significant leap forward in AI speech synthesis, demonstrating its versatility and efficiency by outperforming existing models in various tasks, even those it was not specifically trained for.
ChatGPT is About to Get a Lot Better At Math
New research from OpenAI explores how training reward models with process supervision significantly improves mathematical reasoning compared to outcome supervision.