Connect with us

Latest News

Unlocking the Power of Etched ASIC: Revolutionizing AI Hardware | MATIC News

Avatar

Published

on


Etched is making waves in the artificial intelligence hardware space with its revolutionary new AI accelerator chip. The Silicon Valley startup, founded in 2022 by Harvard dropouts Gavin Uberti and Chris Zhu, has developed a custom application-specific integrated circuit (ASIC) called Sohu that is purpose-built to run transformer models – the architecture behind today’s most advanced AI systems.

Etched transformer ASICS for LLMs

Etched claims its Sohu chip can process AI workloads up to 20 times faster than Nvidia’s top-of-the-line GPUs while using significantly less power. With $120 million in fresh funding and partnerships with major cloud providers, Etched is positioning itself as a formidable challenger to Nvidia’s dominance in AI chips.

Performance of Sohu vs top GPUs (Etched)

Primary Venture Partners and Positive Sum Ventures led the funding round, which included participation from high-profile investors like Peter Thiel, Github CEO Thomas Dohmke, and former Coinbase CTO Balaji Srinivasan. As transformer models continue to drive breakthroughs in generative AI, Etched’s specialized hardware could reshape the landscape of AI computing.

Etched’s approach targets the complexities of GPUs and TPUs, particularly the need to handle arbitrary CUDA and PyTorch code, which demands sophisticated compilers. While other AI chip developers like AMD, Intel, and AWS have invested billions into software development with limited success, Etched is narrowing its focus. By exclusively running transformers, Etched can streamline software development for these models.

Most AI companies use transformer-specific inference libraries such as TensorRT-LLM, vLLM, or HuggingFace’s TGI. Although somewhat inflexible, these frameworks suffice for most needs because transformer models across different applications—text, image, or video—are fundamentally similar. This allows users to adjust model hyperparameters without altering the core model code. However, the most prominent AI labs often require custom solutions, employing engineers to optimize GPU kernels meticulously.

Etched aims to eliminate the need for reverse engineering by making its entire software stack open source, from drivers to kernels. This openness allows engineers to implement custom transformer layers as needed, enhancing flexibility and innovation.

Etched’s approach to AI hardware is comparable to the advancements seen with Groq’s LPU Inference Engine. Groq’s LPU, a dedicated Language Processing Unit, has set new benchmarks in processing efficiency for large language models, surpassing traditional GPUs in specific tasks. According to ArtificialAnalysis.ai, Groq’s LPU achieved a throughput of 241 tokens per second with Meta AI’s Llama 2-70b model, demonstrating its capability to process large volumes of more straightforward data more efficiently than other solutions.

This level of performance spotlights the potential for specialized AI hardware to revolutionize the field by offering faster and more efficient processing capabilities tailored to specific AI workloads. Etched claims its ASIC achieves as many as 500,000 tokens per token with its hardware, dwarfing Groq’s performance.

ASICs changed the game for Bitcoin; will they do the same for AI?

The introduction of ASICs for Bitcoin mining marked a revolutionary shift in the landscape, fundamentally altering the network dynamics. When ASICs were first introduced in 2013, they represented a quantum leap in mining efficiency compared to the CPUs and GPUs that had previously dominated the field. This transition profoundly impacted Bitcoin’s ecosystem, dramatically increasing the network’s overall hash rate and, consequently, its security.

ASICs, being purpose-built for Bitcoin mining, offered unprecedented computational power and energy efficiency, quickly rendering CPU and GPU mining obsolete for Bitcoin. This shift led to a rapid centralization of mining power, as only those with access to ASIC hardware could profitably mine Bitcoin. The ASIC era ushered in industrial-scale mining operations, transforming Bitcoin mining from a hobby accessible to individual enthusiasts into a highly competitive, capital-intensive industry.

Etched history and development

Etched’s vision began in 2022 when AI technologies like ChatGPT were not yet prevalent, and image and video generation models primarily relied on U-Nets and CNNs. Since then, transformers have become the dominant architecture across various AI domains, validating Etched’s strategic focus.

The company is rapidly advancing toward one of the quickest chip launches in history. It has attracted top talent from major AI chip projects, partnered with TSMC for their advanced 4nm process, and secured essential resources such as HBM and server supply to support initial production. Early customers have already committed tens of millions of dollars to Etched’s hardware.

This rapid progress could dramatically accelerate AI capabilities. For instance, AI models could become 20 times faster and cheaper overnight. Current limitations could be drastically reduced, such as the slow response times of models like Gemini or the high costs and long processing times of coding agents. Real-time applications, from video generation to AI-driven conversations, could become feasible, addressing the current bottlenecks faced even by leading AI firms like OpenAI during peak usage periods.

Etched’s advancements promise to make real-time video, calls, agents, and search a reality, fundamentally transforming AI capabilities and their integration into everyday applications.

Mentioned in this article


Continue Reading
Click to comment

Leave a Reply

Your email address will not be published. Required fields are marked *

Latest News

Bahamas to provide CBDC access via commercial banks | MATIC News

Avatar

Published

on

The Bahamas will provide access to its central bank digital currency (CDBC) the “Sand Dollar” through commercial banks to increase adoption, Reuters reported on July 1, citing the country’s central bank governor.

Governor of the Central Bank of The Bahamas John Rolle said the country intends to establish the regulations within two years and has started signaling its intent to banks.

Rolle said:

“We foresee a process where all of the commercial banks will eventually be in that space and they will be required to provide their clients with access to the [CBDC].”

The Central Bank of the Bahamas reportedly sees the change as critical to raising CBDC and mobile payment adoption rates, even though banks will need to significantly modify their existing IT systems to comply with the upcoming obligations.

Rolle said uptake of the Sand Dollar is still limited years after its launch in 2020, requiring a shift from incentives to enforcement.

Adoption in question

Reuters described low adoption statistics amid the news. It reported that the CBDC accounts for under 1% of the country’s currency in circulation.

Reuters said wallet top-ups fell to $12 million in the eight months before August 2023 from $49.8 million in the same period in 2022, based on central bank data.

Rolle previously described “wide use, but very low average transaction value” in an interview with The New Times on June 19. He said 120,000 mobile wallets exist, equal to 20% of retail bank accounts, but mobile wallets make up less than 1% of retail payments.

Strong short-term data

A central bank press release from February described stronger short-term data. It recognized “modest seasonal growth in digital payments activities,” including the Sand Dollar, even though lower government transfer payments impacted overall year-to-date trends.

The bank said that the person-to-business (P2B) and business-to-business (B2B) transactions reached a combined $4.5 million, mainly involving the Sand Dollars, doubling from November 2022. It said personal wallet counts rose 20% year-to-date in December 2023. Sand Dollars in circulation rose 60.8% to $1.7 million.

Bahamas’ mandatory adoption policies could precede other strategies elsewhere. Reuters noted that the European Central Bank similarly intends to require retail and banks to accept and offer any future digital euro if it proceeds with one.


Continue Reading

Latest News

Polkadot treasury holds $245M but faces revenue decline and two-year runway | MATIC News

Avatar

Published

on

The Polkadot Treasury holds assets equivalent to 38 million DOT, worth approximately $245 million. Head Ambassador Tommi Enenkel, popularly known as Alice and Bob, shared a new report providing the latest update on the network’s treasury.

This balance equates to about two years of the runway at its current spending rate. The report stated:

“At the current rate of spending, the Treasury has about two years of runway left, although the volatile nature of crypto-denominated treasuries makes it hard to predict with confidence.”

Polkadot’s first six months of spending

During the first six months of this year, Polkadot invested heavily in its ecosystem, spending 11 million DOT, valued at around $87 million, across various projects.

According to the report, the network invested about $37 million in Outreach activities such as advertisements, sponsorships, and events. The network signed sponsorship deals with race car driver Conor Daly and also pushed several marketing activities designed to bolster the network’s adoption by the broader global community.

Polkadot also spent $23 million developing its network features and upgrades, including SDK, Data Services and Indexing, Governance, and Subwallets.

Moreover, the network invested $15 million in liquidity incentives and $5.5 million in Talent and Education. Additionally, it spent $3.8 million to maintain the network and core ecosystem components, and another $2.1 million went towards Research.

Revenue decline

The report highlighted a decline in Polkadot’s revenue. During the first six months of the year, the network’s total earnings dropped to 171,696 DOT from 414,291 DOT, recorded in the second half of 2023.

Enenkel attributed this decline to the significant drop in network fees, which fell from 313,443 DOT last year to 39,444 DOT in the 2024 first half:

“We see that direct revenue from fees is still marginal. Polkadot made 300k DOT from fees in 2023-H2 from a short-lived inscriptions campaign. Fees under regular conditions are pretty stable with about 20k DOT per quarter. Other sources of revenue are typically transfers from accounts that return funds that they received and pay them back for various reasons.”

Disclaimer: CryptoSlate has received a grant from the Polkadot Foundation to produce content about the Polkadot ecosystem. While the Foundation supports our coverage, we maintain full editorial independence and control over the content we publish.

Posted In: Polkadot, Tokens


Continue Reading

Latest News

Vitalik Buterin suggests ways to speed up Ethereum transaction confirmations | MATIC News

Avatar

Published

on

Ethereum co-founder Vitalik Buterin has suggested ways to help the blockchain improve its transaction confirmation times.

Buterin, in a June 30 blog post, explained that Ethereum’s Gasper consensus mechanism uses a slot-and-epoch architecture that contains certain complexities, like bug interactions and a 12.8-minute confirmation time, that makes it “more and more uncomfortable” for user experiences.

So, he highlighted some of the “practical options” Ethereum has to improve its user experience further.

SSF

Buterin stated that the single-slot finality (SSF) mechanism is similar to the Tendermint consensus, as it allows the finalization of blocks as soon as they are produced.

However, unlike the Tendermint consensus, Ethereum will keep the “inactivity leak” mechanism to allow chains to remain functional even if a third of the validators go offline. Buterin added that the single-slot finality mechanism also has its faults. Notably, all Ethereum stakers must publish two messages every 12 seconds, overloading the chain.

Meanwhile, Buterin furthered that while there are ideas to mitigate this issue, users may still have to wait 5-20 seconds. He wrote:

“There are clever ideas for how to mitigate this, including the very recent Orbit SSF proposal. But even still, while this improves UX significantly by making ‘finality’ come faster, it doesn’t change the fact that users need to wait 5-20 seconds.”

Rollup preconfirmations

Rollup preconfirmations aim to improve Ethereum’s Layer 2 (L2) solutions. These solutions process transactions with the same security as the Ethereum base layer (L1) but on a larger scale.

Rollups confirm transactions much faster than the current 5-20 seconds, targeting latencies of hundreds of milliseconds. This method divides responsibilities — the L1 network remains stable, censorship-resistant, and reliable, while the L2s offer faster transaction times and address user needs directly.

To achieve faster confirmations, L2s create decentralized sequencing networks. These networks have smaller groups of validators who quickly sign off on blocks, often within milliseconds, and commit them to the blockchain.

However, validators must ensure their commitments are consistent and trustworthy. If a validator signs conflicting blocks, they risk losing their deposits.

Based preconfirmations

Based preconfirmations leverage Ethereum proposers’ advanced capabilities, driven by Maximum Extractable Value (MEV) prospects.

The concept involves establishing a standardized protocol where users can pay an extra fee for immediate assurance that their transaction will be included in the upcoming block. This service, known as preconfirmations-as-a-service, would assure users of swift transaction confirmation.

Proposers who fail to fulfill their commitment or breach the agreement face penalties (slashing). Buterin noted that this framework will apply to L1 transactions and extend to L2 solutions. By treating all L2 blocks as L1 transactions, the preconfirmation mechanism ensures accelerated confirmations throughout the Ethereum network.

Buterin noted that Ethereum implementing SSF and rollup or based preconfirmations could significantly reduce transaction confirmation times.

However, he pointed out that this would return to the initial “epoch-and-slot architecture” the blockchain was trying to ditch. He stated:

“There is a deep philosophical reason why epoch-and-slot architectures seem to be so hard to avoid: it inherently takes less time to come to approximate agreement on something, than to come to maximally-hardened ‘economic finality’ agreement on it.”

He suggested that the network developers explore other options that are not as tightly interwoven as Gasper.

Mentioned in this article


Continue Reading

Trending