llm-d 1.0 launches as an open platform for distributed AI inference
Contributors announced version 1.0 of llm-d, an open-source project for deploying and scaling large language model inference across modern infrastructure. IBM says the project is governed by the Cloud Native Computing Foundation and was founded by Red Hat, IBM, Google Cloud, CoreWeave and NVIDIA.
Contributors announced version 1.0 of llm-d, an open-source project for deploying and scaling large language model inference across modern infrastructure. IBM says the project is governed by the Cloud Native Computing Foundation and was founded by Red Hat, IBM, Google Cloud, CoreWeave and NVIDIA.
The release describes a production-oriented core for distributed inference. IBM also cites demonstrations of lower cost and higher throughput, but those figures depend on the workloads and conditions in the linked demonstrations.
The software testing company says it will present services combining human review with model scoring at the 26–27 October event in Dubai. Its announcement provides no independent performance results for the services.
G42 and five portfolio companies will examine potential work with Greek partners on data-centre and cloud infrastructure, public services, life sciences and smart cities. The announced MoUs disclose no investment value or binding project contract.
A NEOM statement dated October 21 says Nebius is party to a preliminary framework for up to 50MW at the planned first 360MW phase of the data-centre campus. The proposed allocation is not yet an operational service; capacity is expected to come online in stages from Q4 2027.
Source: NEOM — HUMAIN, DataVolt and Nebius preliminary framework agreement
Google Analytics can measure visits and site activity using cookies if you allow it. You can change your choice later.
Measurement and privacy details
Google Analytics measurement starts only if you allow it. After consent, automatic measurement may cover scrolls, outbound link clicks, downloads, video engagement, site searches and basic form interactions; search terms may be detected from URL parameters. This site’s own code does not send form field values; email redaction in automatic measurement is best-effort, not guaranteed. Our manual page-view event uses a cleaned URL. You can change your choice later. Visits that begin with consent may also send numeric LCP, INP and CLS performance measurements after Analytics loads. A first or later grant starts this on the next page load; withdrawing consent stops these performance reports for this page. The preference cookie lasts six months; advertising measurement and personalization stay off.
Your browser is sending a Global Privacy Control signal. Analytics is off by default; you may explicitly change this choice here.
