Silicon AI News

Topic

Independent Testing news

Every Silicon AI News story about Independent Testing, month by month, newest first.

4 stories

3 stories

Chips & Infrastructure

Tests find RTX Spark laptops fast at local AI, but hot

Reviewers ran AI models with more than 100 billion parameters on laptops with Nvidia’s new chip. Laptops with RTX 5090 graphics were faster on smaller models, and three testers saw crashes or shutdowns under heavy load.

The first independent tests of laptops with Nvidia’s RTX Spark chip came out on October 15 and 16. In Tom’s Hardware’s test of local AI agent tasks, Apple’s M5 Max MacBook Pro took about 25% longer than Microsoft’s Surface Laptop Ultra. Most AI tests used versions with 128GB of memory, which cost $5,899.99 for the Surface.

4 min read
AI Models

Leaderboard Arena raises $200M and grades agents’ behaviour

Arena says the round values it at $3.1 billion, almost double its value in January. Its new Alignment Index counts how often AI agents act without permission or claim work is done when it is not.

Arena, which runs a popular public leaderboard of AI models, said on October 8 that it raised $200 million at a $3.1 billion valuation. Lightspeed and Khosla Ventures led the round. Arena also launched a preview of its Alignment Index, which scores 27 models on how they behave as agents in real sessions.

3 min read
AI Models

Microsoft’s live transcription model tops an outside test

MAI-Transcribe-2-Streaming turns speech into text as people talk, in 60 languages. Artificial Analysis’s leaderboard shows it with the fewest errors; Microsoft also added two new voice models.

Microsoft AI launched MAI-Transcribe-2-Streaming on October 1, its first model that transcribes speech live, as a person is still talking. It is in public preview in Microsoft Foundry at an introductory $0.54 per audio hour. Microsoft also released two text-to-speech models, MAI-Voice-2.1 and MAI-Voice-2.1-Flash.

3 min read

1 story

Safety & Security

OpenAI says outside experts can test its models in training

It has not named a partner yet.

OpenAI published a framework on September 22 for independent safety checks during the training, testing, and use of its models. It lists four areas for outside review and seven principles. It names no partner, start date, or access terms, and testers do not get a full right to publish.

5 min read