![]() After decades of organic growth, this situation has created a siloed landscape composed of hundreds of products developed and maintained as monoliths, with limited reuse between systems. The requirement for specialization in data management systems has evolved faster than our software development practices. ![]() The Composable Data Management System Manifesto Pedro Pedreira (Meta Platforms)* Orri Erling (Meta Platforms) Konstantinos Karanasos (Meta) Scott Schneider (Meta Platforms) Wes McKinney (Voltron Data) Satya Valluri (Databricks) Mohamed Zait (Databricks) Jacques Nadeau (Sundeck) In doing so, we make two contributions: (i) we highlight the challenges in using DNA for data archival and list several open research problems, (ii) we outline OligoArchive-DSM (OA-DSM)-an end-to-end DNA storage pipeline that we are developing to demonstrate the feasibility of our vision. In this paper, we present a vision for redesigning the archival tier of cloud data lakes based on a novel, obsolescence-free storage medium-synthetic DNA. Current media technologies suffer from fundamental issues that will soon, if not already, make cost-effective data archival infeasible. ![]() Given the growing adoption of data-driven decision making, cloud data lakes are increasingly facing the need to support cost-effective ``Just-in-case'' archival over long time periods to meet legal and regulatory compliance requirements. ![]()
0 Comments
Leave a Reply. |
AuthorWrite something about yourself. No need to be fancy, just an overview. ArchivesCategories |