Nvidia has launched Chat with RTX, an artificial intelligence (AI)-powered chatbot that can run on GeForce RTX 30 Series and 40 Series graphic cards. The Nvidia chatbot can run offline on Windows PCs equipped with the two graphics cards and allows users to customize a generative AI model similar to ChatGPT by OpenAI by connecting it to notes, files and documents for querying.
A blog post by Nvidia revealed that Chat with RTX users can type simple queries into the chatbot to precisely locate information instead of searching through their saved content or notes manually. It uses an open-source model from AI startup Mistral but can also support text-based models such as Meta’s Liama 2. According to Nvidia, the chatbot currently works with PDF, .doc, .xml and .docx formats.
Once users point Chat with RTX to a folder with supported files, the chatbot will automatically load the files into its fine-tuning dataset. Chat with RTX can also use URLs to load video transcriptions from YouTube playlists, allowing the AI model to query their contents as well.
However, Nvidia warned GeForce RTX 30 Series and 40 Series graphic card users that downloading Chat with RTX will require 50–100GB of storage space depending on the model they choose. The graphic processing unit manufacturer also noted that Chat with RTX has limitations. For instance, the chatbot cannot remember context, meaning it does not regard previous questions when answering follow-up questions.
Factors such as question phrasing, the size of the fine-tuning dataset and performance of a user’s preferred model can affect the AI Chabot’s output too. Larger datasets will generally result in higher quality output, Nvidia says.
Although Chat with RTX may not threaten ChatGPT’s market dominance, the app could tap into the growing market for applications that allow users to run artificial intelligence models locally and offline. Users with the RTX 30 or RTX 40-series GPU and at least 8GB of VRAM could use their data as well as YouTube videos to run the chatbot locally and generate relevant answers based on their data.
A recent World Economic Forum report predicted that affordable devices able to run generative AI models offline will experience “dramatic growth.” This includes personal computers (PCs), Internet of Things (IoT) devices, networking equipment and smartphones.
The dramatic growth in this segment is due to the clear benefits of offline AI models, the World Economic Forum said. Offline models offer much more privacy because user data never leaves the owner’s device, they are cheaper, and they have lower latency compared to cloud-hosted AI models.
The world should expect even more AI innovations from leading tech companies such as Alphabet Inc. (NASDAQ: GOOGL) (NASDAQ: GOOG) that have in their own way transformed the technology landscape.
About AINewsWire
AINewsWire (“AINW”) is a specialized communications platform with a focus on the latest advancements in artificial intelligence (“AI”), including the technologies, trends and trailblazers driving innovation forward. It is one of 60+ brands within the Dynamic Brand Portfolio @ IBN that delivers: (1) access to a vast network of wire solutions via InvestorWire to efficiently and effectively reach a myriad of target markets, demographics and diverse industries; (2) article and editorial syndication to 5,000+ outlets; (3) enhanced press release enhancement to ensure maximum impact; (4) social media distribution via IBN to millions of social media followers; and (5) a full array of tailored corporate communications solutions. With broad reach and a seasoned team of contributing journalists and writers, AINW is uniquely positioned to best serve private and public companies that want to reach a wide audience of investors, influencers, consumers, journalists, and the general public. By cutting through the overload of information in today’s market, AINW brings its clients unparalleled recognition and brand awareness.
AINW is where breaking news, insightful content and actionable information converge.
To receive SMS alerts from AINewsWire, text “AI” to 888-902-4192 (U.S. Mobile Phones Only)
For more information, please visit www.AINewsWire.com
Please see full terms of use and disclaimers on the AINewsWire website applicable to all content provided by AINW, wherever published or re-published: https://www.AINewsWire.com/Disclaimer
AINewsWire
Los Angeles, CA
www.AINewsWire.com
310.299.1717 Office
Editor@AINewsWire.com
AINewsWire is powered by IBN