Home Blog Page 86

IBM touts Ceph for data lakehouses, generative AI

It’s a year since IBM integrated Red Hat’s Ceph storage product roadmaps and wants us to know that it’s making progress in this increasingly AI-dominated environment.

Gerald Sternagl, IBM
Gerald Sternagl

A blog going live today written by Gerald Sternagl, manager of Technical Product at IBM Storage Ceph, says: “This self-healing and self-managing platform is designed to deliver unified file, block, and object storage services at scale on industry standard hardware. Unified storage helps provide clients a bridge from legacy applications running on independent file or block storage to a common platform that includes those and object storage in a single appliance.

”Software-defined storage has emerged as a transformative force when it comes to data management, offering a host of advantages over traditional legacy storage arrays including extreme flexibility and scalability that are well-suited to handle modern uses cases like generative AI.”

Sternagl is critical of IBM’s legacy storage array hardware, such as its mainframe DS8000 and x86 server FlashSystem arrays, but he was a Red Hat vet with more than 10 years service before IBM acquired the company.

In his view: “Ceph is optimized for large single and multisite deployments and can efficiently scale to support hundreds of petabytes of data and tens of billions of objects, which is key for traditional and newer generative AI workloads.” It can support data lakehouse and AI/ML open source frameworks and “more traditional workloads such as MySQL and MongoDB on Red Hat OpenShift or RedHat OpenStack.”

There is “a feedback loop where generative AI thrives on the abundance of unstructured data, and the continuous generation of realistic data by AI further enriches and refines your understanding of unstructured datasets, fostering innovation and advancements.”

Some 768 TiB of raw Storage Ceph capacity is included in watsonx.data, IBM’s data lakehouse architecture for data, analytics, and AI workloads.

Sternagl says: “Organizations … need a storage management solution capable of accelerated data ingest, data cleansing and classification, metadata management and augmentation, and cloud-scale capacity management and deployment, such as software-defined storage.” It also needs to support both the on-premises and public cloud environments.

By software-defined storage, he means Ceph of course. His company is not promoting MinIO, Cloudian, Scality, DataCore, or WekaIO here.

In December, IBM updated Ceph with object lock immutability for ransomware protection and previews of NVMe-oF and NFS support for data ingest into the underlying Ceph object store.

Comment

An issue with any three-way combination of block, file, and object storage is that each access protocol implementation has to be aware of the others and this can delay and possibly limit the adoption of new features, such as NVMe-oF and NFS support. If you need all three protocols supported in a single software package then Ceph is a good choice but you may find that block-only, block and file combined, file-only, or object and file combined may support new features faster and also provide speedier data access.

HYCU offers generative AI SaaS app protection builder bot

AI everywhere
AI everywhere

Data protector HYCU is using Anthropic’s Claude generative AI model to produce connector code for a customer’s SaaS app data to be protected by HYCU’s Protégé service.

Customer data in SaaS applications is not protected by the app provider; it’s the customer’s responsibility. There are tens of thousands of such apps and no backup provider can write connector code to backup customer data in all of them. HYCU is hoping customers take up its R-Cloud SDK so the app providers themselves could add a HYCU connector to their apps, and more than 60 such connectors have been built.

HYCU founder and CEO Simon Taylor said in a statement: “This development with Anthropic’s frontier generative AI model Claude is  more than an integration; it’s a leap forward in the future of data protection.”

The Claude model has been trained with HYCU information and uses a SaaS app’s API to build a connector between it and HYCU such that HYCU can backup and restore customer data. This can cut development time from three weeks or so to a matter of  hours.

R-Cloud module generation process.

Taylor told an IT Press Tour briefing that, with Claude: “Customers can button-hit to get R-Cloud to automatically generate an application to protect a SaaS app. … We trained the model. … This bot writes a complete and extensible app and provides testing for it.”

R-Cloud module generation success.

HYCU says the training ensured that Claude “fully understand the nuances of compliance, encryption, and recovery protocols, custom-tailored for HYCU’s platform.” 

The launch of HYCU Claude means that a customer could generate code for a SaaS app protection which could duplicate what other customers have done. HYCU is considering setting up a marketplace for the distribution of such customer-sourced, Claude-built  apps. It had a target of having 100 SaaS app connectors  built by the end of 2023 which did not come to pass, and anticipates Claude-built connectors could send the connector count sky-rocketing. It will stop publicly counting after 100 connectors are available.

R-Scout protection module development query.

HYCU Claude is a significant development from HYCU’s earlier introduction of its R-Scout, an AI -powered assistant for customers and partners to learn about the details of HYCU’s offerings, and how best to use them.

The company has also added the capability to protect data in PineCone and Redis Cloud databases which are both used as vector databases in AI work.

Taylor said: “By harnessing AI, we’re not only accelerating our development processes but also reinforcing our commitment to security and operational  efficiency. We’re excited to take R-Cloud to the next level and pioneer this space and set new standards for the industry.” 

Comment

This is a novel and significant idea which could be adopted by other industry players. There are potential licensing and pricing aspects of such customer-generated but supplier-built extensions to a software product or service. It is a step on from co-pilot-based assistants created by Commvault, Druva, Rubrik and others and gives them a development direction.

Two cloud file data services suppliers going gangbusters

Women sprint hurdlers

Customers are clamoring for cloud-based file data services, and both CTERA and Nasuni are growing strongly on the back of this.

Such services have a cloud-based object storage vault storing files, which are served to accessing customers’ distributed datacenters, remote sites and end-points – typically with local caching to speed access. The central cloud repository synchronizes any file state changes. Startups CTERA and Nasuni are two such suppliers, with Egnyte and Panzura also active.

CTERA announced record results for 2023, driven by strong demand for its AI-based CTERA Ransom Protect. It recorded over 30 percent growth in annual recurring revenue for 2002 to 2023. It revealed it won major deals with state agencies, leading banking institutions, and global media groups. CTERA also expanded its presence in Asia, winning customers in India, Australia, and Singapore. It manages hundreds of billions of files comprising more than 200PB of data.

CEO Oded Nagel issued a statement: “We are thrilled by the staggering market reaction to our recent product releases, which combined with the expansion of our strategic partnerships, have played a pivotal role in increasing our reach and impact.”

Competitor Nasuni also had a good 2023, with a 30 percent growth in ARR. CEO Paul Flanagan stated: “Over the last five years, we have averaged a steady annual recurring revenue growth rate of 30 percent, and we are proud that we’ve done it again in 2023. We have maintained top decile key performance indicators in our business allowing us to be cash flow positive for the year.”

Nasuni has, he claimed: “Over 800 customers, 500 employees, and a very strong balance sheet that has enabled us to avoid any reduction in workforce.” It enjoyed 46 percent growth in new customer Annual Contract Value bookings and won more than 120 large enterprise customers in 2023, with its first eight-figure customer contract for the Nasuni File Data Platform product. 

Like CTERA, ransomware protection was a focus – with an attach rate of 71 percent for its ransomware detection on new customer sales in 2023.

Competitor Panzura has just appointed a new CEO to improve its growth rate.

Kioxia and Phison spearhead advancements in UFS

Kioxia and Phison are both developing UFS 4.0 fingernail flash cards and controllers, with Kioxia currently sampling its device.

UFS (Universal Flash Standard) cards are used for storage and data transfer in smartphones, digital cameras, tablets, smart TVs, augmented reality and virtual reality headsets, and automotive video and logging applications. The standard was developed to provide faster and higher capacity storage than eMMC (embedded MultiMediaCard) flash. The standard has progressed through several generations, with UFS 4.0 the latest: 

UFS specs

UFS gen 2 and 3 cards are available now with gen 4 cards coming on stream.

Phison is launching a range of UFS controllers to support entry-level, middle, premium, and flagship smartphone devices. The line looks like this:

  • UFS 2.2 PS8327 with 64 GB capacity and the smallest UFS 2.2 controller.
  • UFS 3.1 PS8325 for high-end smartphones, supporting the latest 1 Tb NAND from various manufacturers plus Phison’s 4KB LDPC (Low Density Parity Check) error correction engine. It has secured design wins from many international leading smartphone manufacturers and is expected to start mass production in the first quarter of this year.
  • UFS 3.1 PS8329 for mid-range smartphones. It is the smallest UFS 3.1 controller on the market and is planned to begin sampling in June of this year.
  • UFS 4.0 PS8361 for high-end smartphones with a four-channel design. The highest read and write speeds of PS8361 will exceed 4,000 MB/s. Improved read performance per mA to extend the battery usage efficiency of mobile devices. PS8361 has been designated for use by NAND manufacturers and is expected to begin shipping in the second half of this year.
Samsung UFS card
Samsung UFS card

Kioxia is sampling a UFS 4.0 embedded flash card for automotive applications including telematics, infotainment systems, and ADAS. It says the devices support High Speed Link Startup Sequence (HS-LSS) features, enabling Link Startup (M-PHY and UniPro initialization sequence) between device and host to be performed at a faster HS-G1 Rate A (1,248 Mbps) than that of conventional UFS.

The Kioxia card is available in capacities of 128, 256, and 512 GB, supports a wide temperature range, and meets AEC-Q100 Grade 2 automotive stress test standard requirements.

Samsung, SK hynix, and Micron have all developed UFS 4.0 products. SK hynix is pushing ahead with a UFS 5.0 initiative to double bandwidth to 46.4 Gbps which could mean a maximum 11,600 MBps bandwidth.

Bootnote

UFS implements a full-duplex serial LVDS interface. It supports SCSI Tagged Command Queuing. The standard is developed by and available from the JEDEC Solid State Technology Association. UFS can support higher storage capacities with 1 TB than other storage standards, such as eMMC with 256 GB. eMMC is only able to read and write as separate, asynchronous tasks due to its legacy parallel or half-duplex interface.

GigaOm puts NetApp, Pure Storage and Infinidat atop large enterprise primary storage array pack

GigaOm analytical gurus have made large changes in their latest Primary Storage for Large Enterprises report, with only three leaders – NetApp, Pure and Infinidat – compared to six last year. Dell, Hitachi Vantara and IBM have been demoted to challenger status.

The GigaOm Radar for Primary Storage for Large Enterprises looks at 11 of the top primary storage products for large enterprises in the market and compares offerings against the capabilities (table stakes, key features, and emerging features) and non-functional requirements (business criteria) outlined in a companion Key Criteria report. Here is the Radar diagram: 

(Its construction is described in a bootnote below.)

Here for comparison is last year’s diagram:

There were eight evaluated vendors in February 2023: Dell, Hitachi Vantara, HPE, IBM, Infinidat, NetApp, Pure Storage and Zadara. This year there are ten. 

Storage-as-a-Service (STaaS) supplier Zadara has disappeared and is now evaluated by GigaOm in its Sonar for STaaS report. Fujitsu, Seagate and StorPool have entered. 

Assessing the leadership circle rankings last year was complicated by the suppliers all being close to the outside edge of the leadership quadrant. Now we have NetApp clearly in front of Pure Storage, which is in front of Infinidat. All three have a nice balance between innovation and platform product plays, and are classed as outperformers.

There are three outliers. Newcomer Seagate is classed as an entrant based on its Exos X appliances. StorPool, another newcomer, is classed as a challenger with more of a feature play than a platform focus.

IBM is up on its own in the Maturity-Platform Play quadrant and, like Seagate, judged to be a relatively slow mover. GigaOm looked at its established FlashSystem 9500 all-flash array and Spectrum Virtualize architecture.

We would point out that IBM also sells its DS8000 high-end enterprise arrays to its mainframe customers, and these have not been considered by the report’s authors. 

There is a group of four challenger vendors following the three leaders in the Innovation-Platform Play quadrant: Dell, newcomer Fujitsu with its ETERNUS and OEMed NetApp arrays, Hitachi Vantara (VSP 5000), and HPE (Alletra 9000). This group is led by Dell (PowerMax), with HPE close behind and then Hitachi Vantara, Dell again (PowerFlex), and finally Fujitsu.

The GigaOm analysts describe and measure each supplier’s offerings in detail in the full report, which is available to GigaOm subscribers.

Bootnote

The circular Radar diagram has four quarter-circle segments defined by a feature-vs-platform play horizontal axis and an innovation-vs-maturity vertical axis. Three concentric rings are overlaid on this with the outer one for new entrants, the middle one for challengers and the inner one for leaders. Vendor placements have direction of progress arrows indicating if they are a forward, fast or out-performing mover towards the center of the circle.  

Kioxia and WD SSD merger on-off talks are back on again

The cancelled merger talks about a combined Kioxia-Western Digital NAND/SSD business could be on again with Kioxia reportedly talking to WD and Kioxia majority shareholder Bain Capital locked in discussions with minority investor SK hynix, which previously blocked the pairing.

As reported by the Japanese outlet, 47News, Kioxia and Western Digital are reconsidering a unification of the NAND and SSD businesses. The two have a joint-venture to manufacture NAND chips in Japan and they take an approximately equal share of the produced chips to build SSDs. The on-off talks have been complicated by Kioxia having three owners: a Bain Capital consortium with around 56 percent, Toshiba with a near 41 percent, and Japan’s Hoya Corp with the remaining three percent.

This is further complicated by the Bain consortium having five participants, one of which is South Korea-based SK hynix that makes NAND chips and SSDs in competition with Kioxia and Western Digital. This dynamic caused previous merger talks to collapse due to SK’s concerns about its stake’s valuation and its competitive position in the NAND/SSD market when faced with a merged Kioxia-WD NAND+SSD business.

Kioxia ownership and merger possibility

TrendForce measured the relative market shares of the players in the NAND market in 2023’s third quarter as being:

  • Samsung: 31.4 percent valued at $2.9 billion
  • SK hynix + Solidigm subsidiary: 20.2 percent equating to $1.86 billion
  • WD: 16.9 percent with $1.56 billion
  • Kioxia: 14.5 percent with $1.34 billion
  • Micron: 12.5 percent with $1.15 billion
  • Others: 4.6 percent with $423 million

A combined Kioxia + WD business would have a 31.4 percent share of market sales, equal to Samsung’s portion, and leaving SK hynix facing two much larger players.

The situation is muddied further by Western Digital responding to activist investor Elliott Management and agreeing to separate its disk drive and NAND/SSD businesses into separate entities. That separation would be complete some time in the second half of this year.

Kioxia reportedly wants to collaborate with SK hynix in some way without violating antitrust laws. 47News also says Bain is talking with SK hynix about potential involvement in a Kioxia-WD SSD business unit merger. That suggests that SK hynix could own part of a merged Kioxia/WD SSD business.

We note that SK hynix already has two different NAND foundry operations and NAND architectures; its own and that of its acquired Solidigm business. Adding a third NAND architecture to the mix may complicate matters.

There is also the possibility of Kioxia becoming an independent public company as a way for its owners to get a more direct stake in the business. An attempt was made to do this in 2020 but it failed.

Storage news ticker – January 29, 2024

Data protector Acronis announced the integration of its Advanced Security and Endpoint Detection and Response (EDR) solutions. Its users gain access to mission-critical EDR capabilities at no additional cost. It has an MSP-centric design, enhancing technician efficiency through automation and substantially reducing false positives. Acronis recommends that MSPs deploy security to every endpoint to ensure a complete cyber-protection set up. Get more information here.

.…

Sathya Sankaran.

Sathya Sankaran, GM of CloudCasa by Catalogic, wants us to know that 2023 was a good year for CloudCasa. “2023 was the year we fully committed to the open source Velero community and made CloudCasa available to the tens of thousands of Velero users to manage and support their Velero deployments. We’ve seen continued adoption, accelerated by our joining the Azure Marketplace. Additionally, we’re so pleased to see CloudCasa named as a major player in the IDC Marketscape for Worldwide Container Data Management and a leader and outperformer in the GigaOm Radar for Kubernetes Data Protection. We appreciate that we continue to receive validation of our leading Kubernetes data protection offering from the analyst community, as well as our customers, users and partners.” CloudCasa’s spinout from Catalogic however did not happen in 2023.

Commvault has released research showing that while IT and security teams are talking the talk when it comes to joint operations to combat more sophisticated cyber attacks, the reality is that less than half are walking the walk. It says that traditional silos between ITOps and security teams are beginning to break down, as organizations realize the importance of increased collaboration to combat the onslaught of more sophisticated cyber attacks. 

According to the Futurum-produced, Commvault-commissioned “Overcoming Data Protection Fragmentation for Cyber-Resiliency” report, nearly all (99%) respondents indicated that the relationship between ITOps and security has grown more connected over the past 12 months. For those who described the relationship between ITOps and security as “connected,” 64 percent stated they now have shared goals for maintaining the company’s security and 70 percent stated they have joint processes and procedures in place for daily operations. However, there is still work to do. For example, only 48 percent stated they have established joint processes and procedures in place to mitigate or recover from an incident.  

Extending its coverage of archival tape library system suppliers, Hammerspace now supports QStar Archive Manager tape libraries as data sources in its Global Data Environment’s parallel file system and namespace. QStar Archive Manager provides SMB, NFS and S3 protocol options for tape library storage for data suppliers such as Cohesity, Rubrik  and HYCU, and now Hammerspace. Archive Manager is gateway software running on Windows or Linux that presents one or multiple file systems or buckets for simple data management to a growing set of tape media. Learn more here.

IBM announced fourth quarter 2023 results, with revenues up 4% Y/Y to $17.4 billion and profits of $3.3 billion, up 14%. The Infrastructure segment of its results, which includes storage, brought in $4.6 billion, up 3%. No storage sub-segment revenues were revealed. But CFO Jim Kavanaugh said: “Distributed Infrastructure revenue was up 7%, with growth across both Power and Storage. Power performance was fueled by demand for data intensive workloads on Power 10, and Storage traction was aligned to the success of the z16 cycle.” Full year revenues were $61.9 million, up 2%, with profits of $7.5 billion, up almost fourfold on the year from $1.8 billion.

South Korea CXL technology startup Panmnesia is discussing CXL collaboration with HPE. The two have had one meeting so far but more are coming, with CXL’s relevance to HPC and  AI acceleration being matters of interest to HPE.

Data protector Rubrik has celebrated its 10th birthday. A blog by co-founder amd CEO Bipul Sinha says: “Last year, we passed $500 million in subscription annual recurring revenue and currently count more than 5,500 customers.” There are more than 3,000 Rubrik employees.Sinha says: “What’s next for Rubrik? As we have from the beginning, we’ll place no limits on what we can become. We will strive for an infinite outcome as we help organizations dealing with unprecedented volume, variability, and velocity of data build a resilient future in the face of inevitable cyberattacks. We’ll continue to define new frontiers at the intersection of artificial intelligence, business data, and cybersecurity to ensure data is secure and available to the right users on any platform at the right time for the right duration.”

… 

Seagate has applied its Exos 24TB technology to NAS drives with its IronWolf Pro 24 TB, upping the maximum capacity by 2 TB. This 10-platter helium-filled drive tops the existing 2 to 22 TB IronWolf capacity range and has the same 285MBps max sustained transfer rate as the 22 TB drive, 512 MB cache, 6 gig SATA interface, 7,200rpm spin speed, 2.5 million hours MTBF, 5-year warranty and 550 TB/year workload. It has Time Limited Error Recovery (TLER) and rotational vibration (RV) sensors paired with dual plane balancing to lower vibration, and is priced at $649. Get a look at the datasheet here.

Wells Fargo analyst Aaron Rakers calculates, based on our estimate of Toshiba’s 4Q23 HDD revenue totaling ~$665 million during 4Q23, we would estimate that total 4Q23 HDD industry revenue totaled approximately $3.37 billion, down 6.5 percent year on year and up 11 percent quarter on quarter. We now estimate that we are at a point of realizing a return of year on year growth in HDDs with our combined 1Q24 revenue estimate at ~$3.7 billion implying a 7 percent annual increase and an 11 percent jump for the quarter. This would represent the first year over year growth for the HDD industry since 1Q22.

Combined 4Q23 total HDD capacity shipped totaled approximately 215.1 exabytes, down 8 percent year on year and up 9 percent for the quarter. And total 2023 HDD exabytes shipped totalled approximately 849.3 exabytes, down 28 percent year on year and down 38 percent from the peak trailing twelve-month capacity shipped for the period ending 2Q22.

Nearline HDD capacity shipped in 4Q23 totaled ~151.4 exabytes, which was down 7 percent year on year but up 13 percent for the quarter. Seagate and Western Digital’s nearline HDD capacity shipments were up 16 percent and 23 percent respectively during 4Q23, while Toshiba’s nearline HDD capacity shipments were up only 3 percent for the quarter during this time. He estimates that Western Digital and Seagate had a ~44.5 percent and ~43.0 percent nearline HDD capacity ship share during 4Q23 – totalling 87.5 percent and leaving Toshiba with 12.5 percent.

GPU IaaS provider Genesis Cloud is using VAST Data’s storage to help it offer AI initiatives and Large Language Model (LLM) development. The two explain that, by providing fast, real-time access to data across public and private clouds, VAST eliminates data loading bottlenecks to ensure high GPU utilization, better efficiency and ultimately lower costs to the end customer. Germany-based Genesis Cloud has datacenters In Europe and North America with the latest AI accelerators and GPUs, network and storage facilities designed for GenAI, Machine Learning, Simulations, Rendering, and other high-performance computing workloads. This customer win is similar to previous VAST Data wins at CoreWeave and Lambda Labs.

Lola Visual Effects (VFX), which produces computer generated effects for feature films and television series, is using VAST Data storage to help streamline global collaboration on its data-intensive productions. It is adopting AI technologies and deep learning tools to enhance its special effects. VAST’s global namespace and metadata helped with collaboration across Lola VFX’s locations and paved the way for automated asset tracking and integration of production systems, and solved playback caching issues with its previous storage system. That meant it wouldn’t play back 4K footage in real time.

Danny Allan.

Edson Williams, Founder and Managing Partner at Lola VFX, explained: “Our operations demand infrastructure that not only supports but enhances real-time global collaboration. Our demands are extreme, but VAST actually exceeded our expectations. Initially, we anticipated a 24 to 36 month payback period, but with the remarkable efficiency gains we’ve experienced, we expect to see a significant return on our investment in as few as 15 to 18 months.” It bought its first VAST system I 2022. Read the case study here.

Veeam CTO Danny Allan is leaving the company. There is a next step in his career but his LinkedIn post doesn’t say much about it all.

SingleStore adds indexed vector search to Pro Max release for faster AI work

Generative AI’s all-pervading influence has encouraged SingleStore to add new features to its Pro Max release to make AI app development faster.

SingleStore’s eponymous database combines real-time transactional and analytic database features and has hundreds of customers including Siemens, Uber, Palo Alto Networks and SiriusXM. SingleStore surpassed $100 million in ARR in 2022. In April last year it demonstrated how ChatGPT could be used to find data in SingleStoreDB. At the time it said SingleStore was the ideal database for private data search by ChatGPT, “given its abilities to store vector data, perform semantic searches and pull data from various sources without extensive ETL.” Now it’s added AI-relevant tooling to its latest database release.

Raj Verma.

CEO Raj Verma laid it on thick in a statement: “This isn’t just a product update, it’s a quantum leap … SingleStore is offering truly transformative capabilities in a single platform for customers to build all kinds of real-time applications, AI or otherwise.”

The new feature list includes:

  • Indexed vector search. Support for vector search using Approximate Nearest Neighbor (ANN) vector indexing algorithms, leading to 800–1,000x faster vector search performance than precise methods (kNN). This hybrid (full-text and indexed vector) search that takes advantage of SQL for queries, joins, filters and aggregations, and place SingleStore above vector-only databases that require niche query languages and are not designed to meet enterprise security and resiliency needs.
  • On-demand compute service for GPUs and CPUs. This works alongside SingleStore’s native Notebooks to let developers spin up GPUs and CPUs to run database-adjacent workloads including data preparation, ETL, third-party native application frameworks, etc. This capability is said to bring compute to algorithms, rather than the other way around, enabling developers to build highly performant AI applications without unnecessary data movement.
  • CDC: Native capabilities for real-time Change Data Capture in (CDC) for MongoDB, MySQL and ingestion from Apache Iceberg without requiring other third-party CDC tools. SingleStore will also support CDC out capabilities to ease migrations and enable the use of SingleStore as a source for other applications and databases like data warehouses and lakehouses.
  • SingleStore Kai. API to deliver over 100x faster analytics on MongoDB with no query changes or data transformations required. It supports BSON data format natively, has improved transactional performance, increased performance for arrays and offers industry-leading compatibility with MongoDB query language.
  • Projections. Allow developers to greatly speed up range filters and “group by” operations by 3x or more by introducing secondary sort and shard keys.
  • Free shared tier. SingleStore has announced a new cloud-based Free Shared Tier that’s designed for startups and developers to quickly bring their ideas to life – without the need to commit to a paid plan.

Nadeem Asghar, SVP, Product Management + Strategy at SingleStore, said “New features, including vector search, Projections, Apache Iceberg, Scheduled Notebooks, autoscaling, GPU compute services, SingleStore Kai, and the Free Shared Tier allow startups – as well as global enterprises – to quickly build and scale enterprise-grade real-time AI applications. We make data integration with third-party databases easy with both CDC in and CDC out support.”

SingleStore claims its Pro Max database is the industry’s first and only real-time data platform designed for all applications, analytics and AI. It supports high-throughput ingest performance, ACID transactions and low-latency analytics, and structured, semi-structured (JSON, BSON, text) and unstructured data (vector embeddings of audio, video, images, PDFs, etc.).

We are entering a period of NLQ (Natural Language Queries) with generative AI features added to databases, according to Noel Yuhanna, VP and Principal Analyst at Forrester Research. “Generative AI and LLM can help democratize data.”

Western Digital roller coaster continues as Seagate brings down the HAMR

The disk/SSD downcycle low point has been reached for Western Digital with its second successive sequential revenue growth quarter.

Revenues in the second quarter of its fiscal 2024, ended December 29, were $3.03 billion, two percent down year-on-year but up 10 percent sequentially. There was a loss of $268 million, lower than the year-ago $446 million loss. The charted pattern of quarterly results clearly shows a trough has bottomed out: 

WD CEO David Goeckeler said in a canned statement: “Western Digital’s second quarter results demonstrate that the structural changes we have put in place over the last few years and the strategy we have been executing are producing significant outperformance across our flash and HDD businesses.”

Overshadowing the results [PDF] are WD’s decision to split its HDD and SSD units into separate businesses and Seagate’s newly opened-up capacity and density lead with its HAMR tech – but we’ll finish with the quarter’s numbers before getting to these issues.

Financial summary

  • Gross margin: 16.2% vs 17% a year ago
  • Operating cash flow: $92 million
  • Cash and cash equivalents: $2.48 billion

WD sells its SSDs and HDDs into three markets: cloud (enterprise and CSP), client (PC and notebook), and consumer (retail). The client ($1.1 billion, up 3% y/y) and consumer ($839 million, up 6% on seasonal buying) segments grew year-on-year while cloud ($1.1 billion, down 13%) went downhill year-on-year but rose an encouraging 23 percent sequentially;

Its flash-based revenues were $1.7 billion in the quarter, flat year-on-year, while HDD revenues at $1.4 billion were down six percent, although up sequentially. Goeckeler said: “The sequential revenue increase was driven by improving nearline demand and pricing. Moreover, we are encouraged by demand in China with revenue doubling on a sequential and year-over-year basis, both of which were ahead of our expectations. We anticipate year-over-year growth in HDD throughout this calendar year.”

WD said its WD_BLACK gaming SSD products achieved record revenue with bit shipment growth of over 50% year-over-year.

SMR (shingled magnetic recording) disk drives were important as WD shipped approximately one million UltraSMR hard drives in both the first and second quarters of fiscal 2024. It expects SMR drive shipments to comprise the majority of nearline demand by calendar year 2025. Goeckeler said: “SMR drive shipments to continue to outgrow that of CMR drives going forward. Importantly, the adoption of UltraSMR is broadening to our major customers worldwide including a third cloud titan in the US this year, as well as hyperscale and smart video customers in China.”

Goeckeler added: “The sequential revenue increase was driven by improving nearline demand and pricing. Moreover, we are encouraged by demand in China with revenue doubling on a sequential and year-over-year basis, both of which were ahead of our expectations. We anticipate year-over-year growth in HDD throughout this calendar year.”

WD’s disk revenues grew a little closer to industry leader Seagate’s as a chart shows;

Earnings call
CEO David Goeckeler.

Goeckeler was optimistic about the future in an earnings call with analysts on Thursday, saying: “In addition to the recovery in both flash and HDD markets, we believe storage is entering a multiyear growth period … We believe the second wave of generative AI-driven storage deployments will spark a client and consumer device refresh cycle and re-accelerate content growth in PC, smartphone, gaming, and consumer in the coming years. Our flash portfolio is extremely well positioned to benefit from this emerging secular tailwind.”

His prepared HDD remarks seemed, we stress “seemed,” inappropriate as Seagate has just announced its 30 TB and 32 TB HAMR drives, beating WD’s 24 TB PMR and 28 TB SMR disks capacity-wise. Goeckeler said: “In HDD, Western Digital’s leading ePMR platform and enhanced UltraSMR technology allow us to provide the highest-capacity drives for mass market deployment.” Well, actually they won’t, or will they?

He continued: “We have a strong conviction that our portfolio strategy of first commercializing Western Digital’s industry-leading UltraSMR technology, which will be followed by our transition from ePMR to HAMR offers the best TCO to our customers in both the near and long term while delivering leading portfolio profitability in the industry.” 

Then he said: “Over the next several years, we will be introducing a number of exciting products, including multiple generations of nearline drives, combining ePMR, OptiNAND, and UltraSMR technologies in the 30 to upper 30-terabyte capacity range, all of which will be ready for high-volume production to support the explosion of AI training data and content.”

But Seagate is talking about shipping 40+ TB drives in two years. On this basis WD is falling behind. But, in answering a question on the call, Goeckeler said he sees it differently: ”I can tell you our customers have an enormous amount of confidence in our road map, in our current products, and you’re seeing that in the performance of the business. You’re seeing accelerating growth, you’re seeing better profitability, you’re seeing share gains, that’s a clear indication that customers are very happy with our products.”

Also: “For our portfolio, given our UltraSMR technology; it’s been adopted by the market. HAMR does not make sense until you get to four terabytes per platter and because HAMR adds a lot of costs to the product … We will transition to HAMR when we get to that four terabytes per platter, that’s the economic crossover, right, that we’re looking for from a portfolio management point of view.”

Forty terabytes is in reach with WD’s existing technology, Goeckeler said: “We’ve built a technology road map that allows us to get to 40 terabytes on very well-proven, cost-controlled, high manufacturing ability technology. And we’re looking forward to delivering that to the market over the next couple of years.”

NAND and SSDs

In the flash area Goeckeler said: “We remain on track to ramp an array of QLC-based client SSDs utilizing BiCS6 technology. Our ability to combine this new high-performance node with our in-house controller development allows us to offer a portfolio of client SSDs with unmatched performance and value. We expect these products to lead the transition to QLC flash in calendar year 2024. Additionally, BiCS8 yield is progressing well, and we remain on track to productize this technology.”

But WD will not increase flash manufacturing capacity, with Goeckeler saying: “Although flash pricing has started to increase, our profitability and cash generation continue to be well below the level that justify an increase in capital investments. We anticipate wafer equipment spending will remain at historic lows in the near term and flash to be undersupplied for an extended period of time. Overall, we will continue to focus on allocating our bids to the most attractive end markets and anticipate flash ASP increases to be the primary revenue growth driver throughout this calendar year.” Price increases will drive WD flash revenues higher.

The coming split between WD’s HDD and NAND/SSD businesses was not discussed. Wells Fargo’s Aaron Rakers expects an analyst day meeting in the mid to late-summer timeframe to focus on this.

Next quarter’s outlook is for revenues of $3.3 billion +/- $0.1 billion, which will be a 17.7 percent increase on the year-ago Q3. Let the good times roll.

GPU-fueled Nyriad is up for sale

Nyriad, the company offering GPU-powered storage controller technology, is up for sale. 

CEO Derek Dicker

A memo from CEO Derek Dicker reads: “After thoroughly considering and exploring various options, the Nyriad board has decided to actively seek to sell all or part of the company and its  technology. The board believes that Nyriad technology continues to hold great promise and that this step is in the best interest of its shareholders and the long-term sustainability of its technology.”  

So ends, for the time being at least, a brave attempt to rewrite X86-based storage array controller design assumptions by augmenting CPU processors with GPU accelerators.

Nyriad’s founding in 2014 was rooted in New Zealand’s involvement with the Square Kilometre Array (SKA), which at the time was still being planned and is now under construction.

Matthew Simmons and Alex St John co-founded Nyriad as CEO and CTO respectively in NZ to build a storage controller that could cope with exabyte levels of data from the SKA, which will pick up radio signals from outer space to help scientists better understand our universe.

The duo decided to use an Nvidia GPU in the controller, replacing RAID controllers and augmenting the controller’s x86 processor.  The x86 CPU cores controlled the array with GPU cores responsible for computational storage functions and NVMe SSDs providing a fast storage base. This architecture would enable it to handle tremendous levels of incoming data bandwidth through parallel processing by the GPU accelerator.

They developed an Nsulate software and a high-performance storage controller platform by 2018 using $10 million to $20 million of VC funding. Nsulate presented the array as a block device to Linux hosts, doing real-time erasure coding and encryption/decryption, and with internal mirroring to protect against drive failures. However the software, and the business, was immature and things fell apart.

About 60 of its 100-plus staff were laid off by March 2019, and co-founder Alex St John left and sold his shares. New Zealand pulled out of the SKA project ending Nyriad’s reason for existing. But lead investor Guy Haddleton thought the technology still had promise. He became chairman that month, and restructured the company.

Matthew Simmons had left by late 2020 when $28 million in funding was announced, and 32-year IBM vet Herb Hunt was made CEO. He relocated the head office to San Francisco while keeping engineering in New Zealand, and appointed new execs. Sixteen months later there was another restructuring. Haddleton resigned form the chairmanship, Hunt became exec chairman, and Derek Dicker was appointed CEO.

Nyriad array in 2019.

Dicker’s resume included a stint as corporate VP and GM of Micron’s Storage Business Unit. Under his reign Nyriad released H-Series SAN arrays with CPU-GPU controllers and disk drive storage in 2022. They featured fast rebuilds and were marketed into the HPC, media and entertainment, and backup, restore, and archive areas.

It announced it was seeking funding for further development in June last year, having gained customers and channel partners.

That cash has not come to pass as, we understand, the macro-economic situation, the rise of all-flash arrays, and VC investor focus on analytics (think data warehouse, lake, and lakehouse) and AI companies meant that Nyriad was overlooked. Its market traction came to a halt, and Dicker and the board came to the conclusion that a full or partial asset sale was the best option. 

His memo added: “Nyriad recently formally engaged with a firm to administer the sales process on an accelerated timeline, and that firm has begun distributing a sale memo to parties and organizations that may have a strategic interest. With this in mind, the company has taken steps to reduce expenses while it conducts this process.”

This is heart-breaking news for Nyriad’s employees and a grim outcome for its customers, channel partners, and investors. We wish them all the best.

Recovering memory markets fuels SK hynix revenue growth

SK Hynix Icheon campus

SK hynix grew revenues in the final calendar quarter of 2023, the first growth for one and a half years, as memory buyers returned to the market.

The company recorded krw 11.3 trillion ($8.46 billion) in the quarter, 46.9 percent higher than a year ago. There was a loss of krw 1.4 trillion ($1.0 billion), much reduced from the year-ago loss of krw 3.5 trillion ($2.6 billion). SK actually reported an internally measured operating profit – krw 346 billion ($259 million), its first for four quarters. Full year revenues were krw 32.8 trillion ($24.5 billion) with a loss of krw 9.1 trillion ($6.8 billion), SK hynix’s first annual loss in at least seven years. It’s been a severe downturn.

VP and CFO Kim Woohyun stated: “We achieved a remarkable turnaround, marking the first operating profit in the fourth quarter following a protracted downturn, thanks to our technological leadership in the AI memory space.” 

In his view: “We are now ready to grow into a total AI memory provider by leading changes and presenting customized solutions as we enter an era for a new leap forward.”

SK hynix said overall memory market conditions improved in the last quarter of 2023 with demand for AI server and mobile applications increasing and average selling price (ASP) rising. Sales of its main products, DDR5 and HBM3 (used in GPU servers), increased by more than four and five times, respectively, compared with a year earlier. 

It will now proceed with mass production of HBM3E, a main AI memory product, and ongoing development of HBM4, while supplying high-performance, high-capacity products such as DDR5 and LPDDR5T to server and mobile markets, to meet increasing demand for high-performance DRAM. 

SK hynix will also prepare high-capacity server module MCRDIMM ((Multiplexer Combined Ranks Dual In-line Memory Module) and mobile module LPCAMM2 (Low Power Compression Attached Memory Module 2)  to respond to increasing memory demand due to AI server and on-device AI adoption.

Recovery in the NAND market is relatively slower and SK hynix said it would continue to improve profitability and stabilize the business by expanding sales of premium products such as eSSD. The GenAI boom is driving server, and hence memory, sales. As Seagate reported yesterday, any AI fillip for storage has still to come, although storage suppliers are confident it is coming.

LucidLink delivers Strawberries for creatives

LucidLink has turned to Projective Technology to supply remote workers in post-production workflow environments with what it hopes is fast file delivery.

Projective provides post-production facilities for broadcasters, creative agencies, and video production facilities worldwide. LucidLink’s FileSpaces product streams file segments directly from a central cloud vault as they are needed.

Derek Barrilleaux, Projective Technology CEO, said of the partnership this week: “For years everyone’s been trying to run post-production in the cloud. There’s been limited success moving some of the workflows, but latency for true editorial needs remained an issue. LucidLink made real-time collaboration and remote editing possible, but to run post-production at scale in the cloud you need a framework that brings structure and efficiency to your editing projects.

“This is what makes the combination of Strawberry with LucidLink so compelling. Strawberry’s project-based, intuitive workflows, together with LucidLink’s support for remote connectivity, breaks down collaboration barriers and eliminates creative silos.”

The deal involves the the integration of Projective’s post-production collaboration platform, Strawberry, with LucidLink’s remote connectivity software, to provide, they say, the best of both worlds: the structure, security, and versatility of Strawberry with the scale and global accessibility of LucidLink, enabling enterprise-level post-production and accelerating time-to-delivery. 

Strawberry offers what’s said to be intelligence around project management, permissions, and sharing, with comprehensive asset and project-based search capabilities that is supposed to allow users to locate their content quickly, no matter where they are. Capabilities such as Strawberry’s review and approval framework, Avid-style bin locking, and workflow extensions for Adobe Creative Cloud are now extended to remote users through LucidLink’s Filespaces.

Scott Miller, global partners and alliances director at LucidLink, spoke of “delivering a shared space for real-time, remote collaboration. The integration enables multiple users to easily manage their projects at scale through Strawberry’s content management tools, from anywhere, at the same time, and with the flexibility, security, and performance that LucidLink delivers.”

To try out Projective’s Strawberry remote collaboration with LucidLink, book a demo today: projective.io/schedule-a-meeting.

Our view:

Once again the tough demands of the entertainment and media industry provide an opening for a seemingly innovative startup in what some would consider to be a mature area – cloud-delivered file collaboration services. LucidLink is making progress because neither CTERA, Hammerspace, Nasuni, nor Panzura have the functionality and/or partnership required, in our opinion.