• AI Research Insights
  • Posts
  • 馃敟 What is Trending in AI Research?: EvoPrompt + ReLU vs. Softmax in Vision Transformers + DALL路E 3 + CulturaX + What is Trending in AI Tools? ....

馃敟 What is Trending in AI Research?: EvoPrompt + ReLU vs. Softmax in Vision Transformers + DALL路E 3 + CulturaX + What is Trending in AI Tools? ....

This newsletter brings AI research news that is much more technical than most resources but still digestible and applicable

Hey Folks!

This newsletter will discuss some cool AI research papers and AI tools. Happy learning!

馃憠 What is Trending in AI/ML Research? 

How can we automate the process of generating effective prompts for Large Language Models (LLMs) without intensive human effort? This paper introduces EvoPrompt, a groundbreaking framework that fuses the strengths of evolutionary algorithms (EAs) and LLMs to optimize discrete, coherent, human-readable prompts. Foregoing gradients and parameters, EvoPrompt initiates with a prompt population, then utilizes LLMs to iteratively produce new prompts influenced by evolutionary operators, refining based on a development set. Testing on both closed- and open-source LLMs, including GPT-3.5 and Alpaca, across 9 datasets, EvoPrompt outperformed human-crafted and other automatic prompt generation methods, spotlighting the potential of merging LLMs with traditional algorithms.

How can one maintain accuracy when substituting the attention softmax with a point-wise activation in vision transformers? This study reveals that the previously observed accuracy degradation can be alleviated by dividing by sequence length. By training vision transformers of varying sizes on ImageNet-21k, the researchers demonstrate that ReLU-attention, when adjusted this way, can match or even rival the performance of softmax-attention in scalability relative to compute resources.

Check out this free AI webinar on 'OpenAI & Kafka for IoT Streaming Data Analytics' that includes hands-on learning with a live demo and code sharing.

What You鈥檒l Learn:

Latest tools and technology for real-time streaming analytics and Generative AI LLMs

Step-by-step guidance on building robust IoT analytics applications with OpenAI and Kafka.

  Get access to valuable code snippets and best practices to kickstart your own IoT analytics projects.

In a significant technological leap, OpenAI has announced the launch of DALL路E 3, the latest iteration in their groundbreaking text-to-image generation technology. With an unprecedented capacity to understand nuanced and detailed descriptions, DALL路E 3 promises to revolutionize the creative landscape by allowing users to translate their textual ideas into astonishingly accurate images effortlessly. DALL路E 3 is currently in research preview, offering a tantalizing glimpse into its capabilities. However, the broader availability of this cutting-edge technology is set for early October, when it will be accessible to ChatGPT Plus and Enterprise customers through the API and Labs later in the fall.

How can we confidently recover unknown physical systems using limited data in the realm of Partial Differential Equations (PDE) learning? Building upon the interplay between physics and machine learning, this paper offers theoretical assurances on the minimal input-output training pairs necessary for PDE learning. By harnessing the power of randomized numerical linear algebra combined with PDE theory, the researchers propose a data-efficient algorithm. This novel approach is designed to retrieve solution operators of three-dimensional uniformly elliptic PDEs from sparse input-output datasets. Remarkably, it promises an exponential decline in error rate correlated to the training dataset size, ensuring a high success likelihood.

How can the research community address the issue of lack of transparency in training datasets for large language models (LLMs), especially when biases and hallucinations are of concern and there's an evident scarcity of high-quality multilingual datasets? This paper introduces "CulturaX," a massive multilingual dataset tailored for LLM development, encompassing 6.3 trillion tokens across 167 languages. CulturaX undergoes a stringent cleaning and deduplication process, employing stages like language identification, URL-based filtering, metric-based cleaning, document refinement, and data deduplication. By making CulturaX available on HuggingFace, the authors aim to boost research and progress in multilingual LLM development.

馃憠 What is Trending in AI Tools? 

  • Decktopus AI: Decktopus is the ultimate online presentation tool that harnesses the power of AI to help you craft captivating presentations effortlessly

  • Height 2.0 鈥 The autonomous project collaboration tool powered by AI. [Productivity]

  • Adcreative AI: Boost your advertising and social media game with AdCreative.ai - the ultimate Artificial Intelligence solution. [Marketing and Sales]

  • Aragon: Get stunning professional headshots effortlessly with Aragon.

  • SaneBox: SaneBox's powerful AI automatically organizes your email for you, and the other smart tools ensure your email habits are more efficient than you can imagine.

  • Parsio (OCR + AI chat): Automate your data extraction with an AI-powered document parser. [Productivity]

  • Sanebox: SaneBox's powerful AI automatically organizes your email for you. [Email]

  • Rask AI: a one-stop-shop localization tool that allows content creators and companies to translate their videos into 130+ languages quickly and efficiently. [Speech and Translation]

  • Notably: Discover insights from research data instantly with Notably's AI-powered platform. [Sales and Marketing]

Everyday AIHelping everyday people learn and leverage AI