All articles tagged with #benchmarking
Ace Combat 8: Wings of Theve requires 32GB of RAM for comfortable play, as 16GB systems suffer severe stuttering due to high memory usage from Unreal Engine 5 features like Nanite and volumetric clouds. The game, launching October 2, 2026, offers a compelling narrative and realistic flight mechanics, though some players may find cockpit views cluttered during intense combat.
AnTuTu has released the public beta of V12, overhauling CPU and GPU tests and adding new real-world scenarios across CPU, GPU, memory and UX to better reflect everyday device use; scores under V12 will not be directly comparable with past versions due to revised tests and scoring methods.
Researchers argue for a rigorous, task-based framework to define and measure medical AI superintelligence, contending that current benchmarks are misleading and insufficient for evaluating AI performance, safety, and reliability in medicine.
Tom's Guide pits ChatGPT-5.5 against Claude Opus 4.7 in seven tough prompts spanning probability, math proofs, chemistry reasoning, and calculus. Across the board, Claude delivers deeper reasoning and more formal demonstrations, with ChatGPT-5.5 showing strengths in structured and straightforward solutions but often lacking the same level of rigor, leading to Claude as the overall winner in this head-to-head AI face-off.
Geekbench 6 results show the MacBook Air with the 10-core M5 chip scoring 17,073 in multi-core, about 15% faster than the M4 Air (14,731); the gain aligns with Apple’s claims and places the M5 Air ahead of the older M3 Pro MacBook Pro by up to 16%, though it remains slower than some M4 Pro/newer Pro models. The M5 MacBook Air is available to pre-order now and launches March 11.
A new benchmark called Humanity’s Last Exam aims to measure how close today’s AI models come to human-level knowledge by presenting 2,500 carefully vetted, PhD-level questions across 100+ subjects. Launched in 2025, it has been attempted by top models like GPT-4o, Google Gemini The top score reported so far is 48.4% (Gemini 3 Deep Think), far below typical human expert performance (~90%). The test prioritizes precise, non-searchable knowledge and verifiable answers, filtering out questions AI could answer via web search. While a high score would indicate expert-level capability in specific domains, researchers say it does not by itself signal AGI or autonomous, general intelligence.
Phoronix compares Windows 11 Home and Ubuntu 26.04 on an MSI Prestige 14 Flip Panther Lake laptop (Intel Core Ultra X7 358H with Arc B390). Using the same balanced power profile, the test found near-identical performance between Windows and Linux, though MSI’s Linux power limits were initially conservative relative to Intel’s guidance; Linux remains competitive on Panther Lake with the latest kernel and Mesa drivers across CPU and graphics benchmarks.
A series of benchmarks on Windows XP through Windows 11 on the same laptop reveal that despite hardware improvements, Windows 11 performs worse than older versions in startup speed, memory management, and overall responsiveness, highlighting increased resource usage and software bloat in newer Windows versions.
Two years after its launch, Intel Meteor Lake's Linux performance has declined to 93% of its original benchmarks, contrary to typical improvements seen in similar hardware, with newer software and hardware updates not translating into performance gains.
AMD has discontinued its AMDVLK driver in favor of focusing solely on the RADV driver for Vulkan on Linux, with recent benchmarks showing significant improvements in RADV's performance, especially in Vulkan ray-tracing, making it a strong choice for Linux gamers and workstation users.
A comparison of gaming performance between Windows 10 and Windows 11 on a high-end gaming PC shows that performance is largely similar, with minor variations in minimum FPS in some games. The article suggests that upgrading to Windows 11 won't significantly impact gaming performance and discusses options for users who wish to delay upgrading beyond the end-of-life support date for Windows 10 in October 2025.
Anthropic revoked OpenAI's access to its Claude large language models after discovering that OpenAI was using the models to benchmark and develop its own competing AI, violating the terms of service. While OpenAI can still perform safety evaluations, its ability to use Anthropic's tools for development has been cut off, highlighting tensions in AI model sharing and competition.
AI agents currently perform poorly in office tasks, with success rates around 30-35%, and many marketed as 'agentic AI' are not truly autonomous. Studies by CMU and Salesforce highlight significant limitations and failures, with Gartner predicting most agentic AI projects will be canceled by 2027 due to high costs and unclear value, though adoption is expected to grow by 2028.
Samsung's Exynos 2400 chipset in the Galaxy S24 competes well against last year's Snapdragon 8 Gen 2 in CPU performance but lags behind in GPU tests due to thermal throttling. The Exynos 2400 shows promise for future gaming with ray tracing capabilities, but overall, the Snapdragon 8 Gen 3 in the Galaxy S24 Ultra outperforms it. Customers seeking peak performance should consider the S24 Ultra, especially for gaming.
A comprehensive comparison of AMD Radeon RX 7000 series and NVIDIA GeForce RTX 40 series performance under Linux has been conducted, including the first look at the GeForce RTX 4070 series and RTX 4080 SUPER performance. The article provides details on the specifications and performance of the newly received NVIDIA graphics cards for Linux benchmarking, such as the GeForce RTX 4070, RTX 4070 SUPER, RTX 4070 Ti SUPER, and RTX 4080 SUPER.