Open Source lakeFS data version control levels up to 1.0
CIOREVIEW >> >> NEWS

Open Source lakeFS data version control levels up to 1.0

CIO Review

Treeverse, creators of the open-source lakeFS data version control system, today announced the release of lakeFS 1.0. This major update brings production-level stability, security and performance to the data lake version control software.

The lakeFS project got its start back in 2020 and has been steadily improving in the years since, providing an open source technology to help organizations with version control for object storage based data, stored in data lakes.

Treeverse, the lead company behind the technology, raised $23 million back in 2021 to build out the concept that delivers capabilities that are similar to the open source Git version control system, to data lakes. In 2022, the technology got a cloud service with Treeverse launching the lakeFS cloud offering providing a managed cloud service data version control. The lakeFS approach has found a receptive audience according to Treeverse, with large enterprises including Lockheed Martin, Volvo and Arm among the technology’s users.

The lakeFS 1.0 technology is now also able to integrate with other data lake technologies, including Databricks as well as the open source technology Apache Iceberg that is increasingly being widely adopted by cloud data vendors, including Cloudera and Snowflake among others.

“We have a large base of installations and really a product that reflects what people need for data version control over a data lake,” Einat Orr, Co-founder and CEO at Treeverse, told VentureBeat in an exclusive interview.

What lakeFS data version control bring to the data lake market

Data version control allows users to track changes to data over time, similar to how version control systems like Git track changes to code.

With the open source Git version control system, that is at the heart of GitHub and much of modern application development, there is the concept of being able to have different versions of code and different branches. It’s a wildly popular approach to development that lakeFS has extended to the world of data stored in data lakes.

The idea of versioning in data lake deployments has a lot of nuance, as multiple vendors and technologies have varying degrees of versioning capabilities. Orr noted that while other technologies including Databricks and Apache Iceberg may allow creating versions of tables or schemas, that is different than a full data version control system.

Orr explained that lakeFS provides a full version control experience across an organization’s entire data lake, not just specific tables or schemas. This allows versioning entire data pipelines and workflows together. The lakeFS technology stores metadata about each version and changes that are important for reproducibility and integration.

Treeverse is not necessarily positioning lakeFS as a competitor to technologies like Databricks or Apache Iceberg but rather as a complementary technology that provides additional benefits to users. Orr also noted that lakeFS integrates with data orchestration tools including Apache Airflow, Prefect and Dagster, bringing the power of data version control to the data pipeline workflow.

The intersection of lakeFS and AI

There are a number of different data analytics and AI use cases for the lakeFS technology.

Looking at AI and machine learning (ML), Orr said that one interesting use case is that data scientists can use lakeFS to version data locally for model development and testing purposes, through a new lakeFS local capability.

Orr explained that data scientists and AI/ML model developers will often deal with a lot of data. That said, she noted that for testing and development, developers will sometimes be doing the research on their own local systems, which is what the new lakeFS capabilities help to enable.

Looking forward, Orr said that her company is in the early stages of figuring out how to integrate and enable data version control capability for vector database technologies.

“Our vision is to be the version control tool that is running over all your data sources, and providing you the ability to version control your data pipelines, no matter where the data is,” she said.

More in News

An intelligent document management solutions company can help businesses turn scattered information into a more organized and accessible resource for everyday operations. As teams handle growing volumes of contracts, invoices, reports and internal records, locating the right information quickly becomes essential to maintaining workflow continuity. Intelligent document management solutions can simplify document retrieval, support consistent recordkeeping and improve access to relevant information across departments. For organizations managing complex documentation requirements, these capabilities can reduce time spent searching for files, support better coordination between teams and help employees make informed decisions using the information they need. Trends in Intelligent Document Management There is an increasing emphasis on intelligent document management solutions by businesses due to increased regulations and standards for compliance, auditing and information governance becoming necessary. Organizations in sectors such as healthcare, banking, insurance and legal services are seeking systems that support retention policies, controlled access and traceable document activity. This shift reflects a growing need to manage sensitive business information according to industry-specific rules while maintaining stronger oversight of documentation practices. Demand is growing for adaptable deployment options that support hybrid work arrangements and meet the diverse operational needs of organizations. Companies are evaluating cloud-based and hybrid systems based on data residency requirements, internal security policies and existing IT investments. Subscription-based pricing and modular capabilities are attracting organizations that prefer to expand document management functions gradually rather than commit to extensive infrastructure changes at the outset. Market demand is moving toward solutions that support multilingual content, industry-specific workflows and collaboration across geographically distributed teams. Businesses operating in multiple regions need document processes that account for different languages, local regulations and internal approval practices. This is encouraging providers to offer configurable capabilities suited to diverse operating environments, while buyers increasingly assess ease of integration, vendor support and long-term adaptability when selecting a solution. Innovative Strategies for Mastering Document Management Success The process of integrating intelligent document management with the already existing business application may prove tricky because the legacy software uses data formats that are not compatible with those being used in the new system. These technical differences may disrupt established processes and increase implementation time. A detailed compatibility assessment before deployment can help identify potential conflicts early. Pilot testing, clearly defined integration requirements, and a staged rollout can further reduce disruption while allowing technical teams to resolve issues before full implementation. The confidentiality of information is another major challenge, especially for organizations that have financial information, personnel details, contracts and proprietary business information. Access control policies that are weak, coupled with poorly designed permission structures, may leave information exposed to those who should not access it. Organizations can address these risks through role-based access restrictions, encryption, multifactor authentication and regular security assessments. Establishing clear incident response procedures helps teams respond promptly to potential breaches and maintain stronger control over sensitive information. Classification of documents can be made complicated when documents are filled with handwritten entries, a lack of uniform formatting, low-quality scans and specific terminologies. Companies can ensure accurate outcomes by developing standard document templates wherever possible and specifying confidence levels in the automated process, which will be used to route unclear documents for review. Periodic accuracy assessments and targeted model adjustments can help maintain dependable results as document types and business requirements change. Revolutionizing Document Management for Tomorrow's Innovations The generative form of artificial intelligence opens up new ways to draw insight from large corporate documents such as contracts, research reports and technical documentation. Instead of relying solely on keyword searches, emerging systems can summarize complex material, identify relevant clauses and answer questions based on document content. These capabilities could help legal teams, analysts, and executives review information more efficiently while keeping human judgment central to decisions that require interpretation. Another promising development is the growing use of knowledge graphs and semantic analysis to uncover relationships between information stored in different documents. These methods can help organizations connect related projects, trace references between reports and identify patterns that might otherwise remain unnoticed. For an intelligent document management solutions company, developing capabilities that support deeper contextual analysis could create new opportunities in research-intensive industries and businesses handling complex technical information. Intelligent document management solutions are likely to move toward more context-aware systems that help organizations interpret information and apply it to specialized business tasks. Opportunities may emerge in contract analysis, technical research, regulatory interpretation and knowledge discovery across large document collections. Providers that combine useful intelligence with transparent results and dependable human oversight will be better positioned to meet increasingly sophisticated business needs and shape the next stage of intelligent information management. ...Read more
Microsoft PSA solution is helping businesses bring greater control and consistency to project delivery by connecting resource planning, time tracking, project financials and performance monitoring within a unified digital environment. As organizations manage multiple client engagements, these capabilities enable teams to allocate talent more effectively, track project costs and identify billing gaps before they affect revenue. Integration with Microsoft business applications would facilitate better communication between project managers, financial teams and management personnel, allowing for a more efficient decision-making process. For professional services firms seeking stronger project visibility and predictable financial outcomes, the Microsoft PSA solution offers a practical way to improve operational efficiency, strengthen client relationships and align project execution with broader business goals. Evolving Market Dynamics in Microsoft PSA Solutions The Microsoft PSA solution market is witnessing shifting demands due to how the professional services organizations are reacting to reduced budgets of their clients, reduced sales cycle time and increased competition. The buyers have become more interested in pricing options, implementation time and flexibility in customization to their models. These considerations are influencing purchasing decisions, particularly among firms seeking to modernize their service operations without introducing unnecessary complexity. Cloud computing is influencing the demand for the market through flexibility in cloud deployment, considering how organizational structures will change over time and how the business will expand. Purchasing decisions depend on factors such as data security, integration requirements, migration costs and the complexity of existing systems. Smaller firms may prioritize affordability and ease of implementation, while larger organizations often assess scalability, governance and compatibility with established processes. Competition between the various solution vendors has led to the creation of a more tailored and industry-specific approach. Professional services firms increasingly expect technology investments to reflect their operational needs rather than require extensive changes to established workflows. This shift is creating opportunities for providers to serve specialized sectors, support varied business models and offer more adaptable purchasing options. As buyers become more selective, the ability to demonstrate clear commercial value and meet industry-specific requirements is likely to influence future adoption. Strategic Solutions in Microsoft PSA Implementation The implementation of a Microsoft PSA solution can be a challenge when the current business processes within an organization are not well understood by employees and are not documented. Variations in approval hierarchy, contractual agreements and internal reporting processes could affect the configuration and implementation process. A phased implementation approach can help organizations address these issues systematically. Mapping current workflows, defining clear responsibilities and testing configurations before organization-wide rollout can reduce disruption and establish a more reliable foundation for adoption. Data migration is yet another challenge, especially when the data to be migrated comes with duplicates and is incomplete. Data transfer into the new system from an untrusted source may result in incorrect data entry, causing errors in reports and decisions made by businesses. Organizations can address this risk through data cleansing, validation checks, controlled migration trials and reconciliation before final deployment. Establishing clear data ownership and regular quality reviews helps maintain consistency as information is updated over time. Employee adoption can become a major obstacle when teams find new processes difficult to understand or view implementation as an additional administrative burden. Limited training, resistance to procedural changes and unclear accountability can prevent organizations from realizing the expected value of their investment. Role-specific training, practical demonstrations, accessible support and feedback sessions can help employees build confidence in the new system. Involving key users during testing and rollout also allows implementation teams to identify usability issues early and make adjustments that encourage lasting adoption. Technological Advancements and Future Prospects AI is opening new possibilities for Microsoft PSA solution providers by supporting smarter analysis of service operations and business performance. Emerging capabilities can help identify patterns in historical project data, flag unusual cost variations and generate insights that support more informed planning. Document automation and suggestions can also help in removing repetitive tasks, which in turn can enable professional service providers to adapt to changing business environments quickly. The improvements in the realm of low-code development, application programming interfaces and data analytics are leading to possibilities of fine-tuning the features of the PSA solution to meet the unique needs of the business organization. Organizations can build custom extensions, connect selected third-party applications and develop dashboards that present relevant performance indicators in a clearer format. However, the practical value of these innovations depends on data quality, integration compatibility, access controls and careful oversight of automated outputs. Responsible implementation will remain essential as these capabilities become more widely adopted. The Microsoft PSA solution market is likely to place greater emphasis on intelligent automation, predictive insights and configurable digital workflows. Further advances in AI-assisted analysis could help firms recognize emerging risks, assess changing service demands and identify opportunities for business growth. Success will depend not simply on adopting new technology but on selecting capabilities that deliver measurable results. Organizations that balance innovation with sound governance and clear business objectives will be better positioned to adapt to the next phase of professional services transformation. ...Read more
Businesses today rely on digital communication channels not only to engage customers but also to manage internal processes and operational workflows. Messaging platforms have become central to customer interactions, and organizations are increasingly seeking ways to connect these conversations to back-office functions. This shift has driven the adoption of automation technologies that streamline communication while improving operational efficiency. A whatsApp backoffice automation platform plays an important role in helping organizations bridge the gap between customer engagement and business operations. Customers expect quick responses and seamless service experiences. Traditional methods often require employees to manually transfer information from conversations into business systems, which can create delays and increase the likelihood of errors. Automation platforms address this challenge by connecting messaging interactions with workflows such as order processing, customer support ticket creation, appointment scheduling and document management. By reducing repetitive manual tasks, organizations can improve productivity while ensuring that customer requests are handled more efficiently. Automation also helps create consistency across business processes. When information received through messaging channels is automatically routed to the appropriate departments, organizations can maintain accurate records and improve collaboration. Employees spend less time managing routine administrative work and more time focusing on activities that require expertise and decision-making. This contributes to faster service delivery and stronger operational performance. How Do Automation Platforms Connect Communication with Business Processes? The value of automation lies in its ability to transform conversations into actionable business data. Messages received from customers can trigger predefined workflows that initiate tasks within enterprise systems. Whether a customer is requesting support, submitting documentation or seeking product information, the platform can automatically direct the request to the appropriate process. Integration capabilities are a key component of modern automation solutions. These platforms often connect with customer relationship management systems, enterprise resource planning software, and help desk applications. This allows information to move seamlessly between communication channels and operational systems without requiring manual intervention. As a result, businesses gain greater visibility into customer interactions while maintaining efficient internal workflows. Automation can also support compliance and governance requirements. By maintaining centralized records of communications and associated actions, organizations can improve accountability and simplify audit processes. This is particularly valuable in industries where documentation and process transparency are critical. What Benefits Does a WhatsApp Backoffice Automation Platform Deliver? A whatsApp back-office automation platform enables organizations to scale customer engagement while maintaining operational control. Automated workflows reduce response times, improve accuracy and help ensure that customer inquiries are addressed promptly. This creates a more responsive and reliable service experience. The platform also enhances resource utilization by minimizing repetitive administrative work. Teams can focus on strategic initiatives and customer relationships rather than routine data entry and process coordination. Improved workflow efficiency supports business growth without requiring proportional increases in operational resources. As organizations continue to modernize their digital operations, communication and back-office systems must work together effectively. A whatsApp backoffice automation platform enables this connection by turning conversations into coordinated actions. By bridging communication and operations, businesses can achieve greater efficiency, stronger customer experiences and more agile organizational performance. ...Read more
 Advanced coating solutions have become an important part of modern manufacturing and industrial operations. While coatings have traditionally been associated with appearance, their role today goes far beyond aesthetics. It helps protect surfaces from corrosion, wear, chemicals, moisture, and extreme temperatures. Industries including automotive, aerospace, electronics, healthcare, construction, and energy depend on these solutions to improve durability and support reliable performance. As expectations continue to rise, manufacturers are investing in coatings that offer stronger protection, longer service life, and better environmental performance. Why Are Advanced Coating Solutions Becoming More Important Across Industries? Equipment and components are expected to perform reliably for longer periods, often in challenging operating environments. This growing demand for durability is one reason advanced coatings are being used more widely. In automotive and aerospace applications, for example, coatings help protect critical parts from corrosion, surface wear, and constant exposure to demanding conditions. Better protection often translates into longer equipment life and fewer maintenance interventions. Cost efficiency is another important consideration, as companies look for practical ways to improve performance without increasing operating expenses. High-performance coatings can help reduce friction, improve energy efficiency, and slow the rate of surface degradation. In construction and infrastructure projects, protective coatings help buildings, bridges, and industrial structures withstand years of exposure to weather, moisture, and other environmental stresses, reducing repair requirements and supporting lower maintenance costs over time. Environmental concerns are becoming more important for many businesses, which want coating solutions that perform well while helping reduce their environmental impact. Because of this, water-based coatings, low-VOC products, and cleaner application methods are becoming more popular. These options help lower emissions without affecting quality, durability, or performance. What Technologies Are Driving Innovation in Advanced Coating Solutions? Nanotechnology is helping improve coating performance in practical ways. By adding nanoparticles to coating formulations, manufacturers can increase scratch resistance, corrosion protection, and overall durability without significantly increasing coating thickness, making these coatings well-suited for applications where long-term protection is important. Similarly, smart coatings are bringing new capabilities, with some that can react to changes in temperature, humidity, or mechanical stress. In contrast, others can indicate early signs of wear or damage, giving operators better visibility into equipment condition, making maintenance planning easier and helping improve asset reliability over time. Application technology is improving alongside coating materials. Robotic systems and automated spray equipment help achieve more consistent coverage while reducing material waste. The result is improved quality control and greater efficiency throughout the production process. Digital monitoring tools are becoming increasingly common in manufacturing environments. ...Read more