Such a distributed computing network, he said, “results in the ability of AI to distribute and distribute computing ‘outside’, placed on smaller platforms closer to population centers and users.” Benjamin Leecomputer architect and engineer at the University of Pennsylvania, in correspondence with Ars. “The strategy can have smaller impacts on the network because the results require a few GPUs, as opposed to training, which requires thousands of people working in concert,” he said.
However, AI inference tasks can be as diverse as document question-and-answer, software code generation, and multi-threaded conversations — each with different computational requirements and performance expectations, Lee cautioned. Thus, it will be important to ensure that individual computing nodes can provide the performance needed for each task while maintaining network connectivity between nodes.
Li also questioned whether data centers should be scaled down to “the elegance of a few GPUs” to reduce the load on the power grid. He hypothesized that deploying conventional 20-megawatt data centers instead of 1-gigawatt hyperscale data centers might be just as beneficial.
The initial SPAN envisages a pilot deployment of XFRA nodes in 100 homes in 2026, followed by rapid scaling in 2027.
Then there is the issue of security. XFRA nodes spread across suburban areas may be more vulnerable to certain data security threats than centralized data centers. “Many side-channel attacks require physical proximity to a machine that data centers can protect,” Lee said. “Distributed GPUs in individual homes are more difficult to secure.”
Thieves may also find XFRA nodes near homes a tempting target, as the Nvidia GPUs inside can sell for around $10,000 each. A few comment threads about Reddit Having already speculated about this possibility, some commentators have suggested that residents would feel the urge to secure such computing resources for themselves. “Of course, there is a risk of losing the actual hardware itself through theft,” Lee said.
Any potential benefits and side effects will become clearer during the pilot deployment phase of SPAN. But at a time when Silicon Valley is exciting right now orbital data centers and AI data centers going to the oceandata center hubs installed in the suburbs can rest on a firmer footing—at least until homeowners associations catch wind of them.
