Large Language Model

Created by Simon Sharwood //

Tue 11 Apr 2023

A large language model (LLM) is a type of artificial intelligence (AI) that's been trained on a massive dataset of text and code. This allows them to understand and generate human-like language in a variety of ways, making them potentially incredibly versatile tools. They do have their downsides, particularly that they can confidently hallucinate – invent, in other words – false answers and information. You should use this experimental and unproven technology with care.

Benchmarks show even an old Nvidia RTX 3090 is enough to serve LLMs to thousands

For 100 concurrent users, the card delivered 12.88 tokens per second—just slightly faster than average human reading speed

Systems23 Aug 2024 | 12

Topics

Special Features

Vendor Voice

Resources

Large Language Model

xAI picked Ethernet over InfiniBand for its H100 Colossus training cluster

Google reportedly developing an AI agent that can control your browser

Hugging Face puts the squeeze on Nvidia's software ambitions

Intern allegedly messed with ByteDance's LLM training cluster

AI 'bubble' will burst 99 percent of players, says Baidu CEO

OpenAI appoints international expansion boss

BROADER TOPICS

NARROWER TOPICS

NARROWER TOPICS

Meta gives Llama 3 vision, now if only it had a brain

AI code helpers just can't stop inventing package names

Data harvesting superapp admits it struggled to wield data – until it built an LLM

Alibaba Cloud claims its modular datacenter architecture shrinks build times by 50 percent

AI has colonized our world – so it's time to learn the language of our new overlords

GenAI hype meets harsh reality as enterprises wrestle with business case

Cerebras gives waferscale chips inferencing twist, claims 1,800 token per sec generation rates

A quick guide to tool-calling in large language models

Buying a PC for local AI? These are the specs that actually matter

Benchmarks show even an old Nvidia RTX 3090 is enough to serve LLMs to thousands

Lawyers say US cybersecurity law too ambiguous to protect AI security researchers

What AI bubble? Groq rakes in $640M to grow inference cloud

Zuck dreams of personalized AI assistants for all – just like email

How deliciously binary: AI has yet to pay off – or is transforming business

Google DeepMind's latest models kinda sorta take silver at Math Olympiad

Meta claims ‘world’s largest' open AI model with Llama 3.1 405B debut

Websites clamp down as creepy AI crawlers sneak around for snippets

OpenAI’s GPT-4o Mini is indeed small – like its lead over rivals in certain tests

Fujitsu picks model-maker Cohere as its partner for the rapid LLM-development dance

You know what spreadsheets need? LLMs, says Microsoft

Privacy warriors gripe to UK watchdog about Meta harvesting user data to train AI

Honey, I shrunk the LLM! A beginner's guide to quantization – and testing it

CyrusOne scores another $7.9B in debt financing to expand AI datacenter empire

Babel fish? We're getting there. Reg reviews the Timekettle X1 AI Interpreter Hub

A friendly guide to containerization for AI work

A friendly guide to local AI image gen with Stable Diffusion and Automatic1111

Alibaba Cloud reveals its datacenter design, homebrew network used for LLM training

Etched looks to challenge Nvidia with an ASIC purpose-built for transformer models

Bake an LLM with custom prompts into your app? Sure! Here's how to get started

Anthropic delivers Claude 3.5 model – and a new way to work with chatbots

Study employs large language models to sniff out their own bloopers

World's top AI chatbots have no problem parroting Russian disinformation

From RAGs to riches: A practical guide to making your local AI chatbot smarter

Brazil recruits OpenAI in brave bid to slash court battle costs

Tackling potty-mouth chatbots to leaky LLMs. What's life like in Microsoft's AI red team?

Millions forced to use brain as OpenAI's ChatGPT takes morning off

Checkmate? AI's pawn-pushing prowess proves partly pitiful, partly promising

LLMs can write and answer quizzes – but aren't quite ready to disrupt trivia night

I stumbled upon LLM Kryptonite – and no one wants to fix this model-breaking bug

China creates LLM trained to discuss Xi Jinping's philosophies

Lawmakers advance bill to tighten White House grip on AI model exports

Big Tech, VC firms pump $1B into ML data darling Scale AI

Hugging Face to make $10M worth of old Nvidia GPUs freely available to AI devs

Aleph Alpha enlists Cerebras waferscale supers to train AI for German military

Meet Pi-CARD: Serving up a digital assistant on Raspberry Pi

Warren Buffett voices AI fears, likens tech to atom bomb

Intel, Ampere show running LLMs on CPUs isn't as crazy as it sounds

Forget the AI doom and hype, let's make computers useful

With Run:ai acquisition, Nvidia aims to manage your AI kubes

Microsoft shrinks AI down to pocket size with Phi-3 Mini

Meta lets Llama 3 LLM out to graze, claims it can give Google and Anthropic a kicking

Indian PM's 25-year roadmap laid out with help from AI

OpenAI launches Asian operations in Tokyo to avoid being lost in translation

How to coax ChatGPT into making better predictions: Get it to tell tales from the future

ChatGPT-3.5, Claude 3 kick pixelated butt in Street Fighter III tournament for LLMs

US House mulls forcing AI makers to reveal use of copyrighted training data

About Us

Our Websites

Your Privacy