Healthcare AI Regulations and Ethics – 2024 Health IT Predictions
CIOREVIEW >> >> NEWS

Healthcare AI Regulations and Ethics – 2024 Health IT Predictions

CIO Review

As we kick off 2024, we wanted to start the new year with a series of 2024 Health IT predictions. We asked the Healthcare IT Today community to submit their predictions and we received a wide ranging set of responses that we grouped into a number of themes. In fact, we got so many that we had to narrow them down to just the best and most interesting. Check out our community’s predictions below and be sure to add your own thoughts and/or places you disagree with these predictions in the comments and on social media.

All of this year’s 2024 health IT predictions (updated as they’re shared):

• John and Colin’s 2024 Healthcare IT Predictions

• Health Equity Predictions

• Healthcare Cybersecurity Predictions

• Telehealth and VR Predictions

• Value Based Care Predictions

• Pharma IT and AI Predictions

• Healthcare Interoperability, Data, and Cloud Predictions

• Healthcare Workforce Predictions

• Healthcare Generative AI and Data Predictions

• Healthcare AI Regulations and Ethics Predictions

• Cautionary Views of AI

• Patient Preditions

• Uses of AI in Healthcare Predictions

• General Health IT Predictions

• Health IT Predictions (on video)

• Healthcare AI Predictions

And now, check out our community’s Healthcare AI Regulations and Ethics predictions.

Anika Heavener, Vice President of Innovation and Investments at The SCAN Foundation

Health equity continues to be a hot topic in 2023 but even with all the advancements in healthcare technology, older marginalized adults still aren’t getting the care they deserve. What’s contributing to the delay? The lack of quality standards for health and social data collection – and then its subsequent application – limits how healthcare technology can prioritize and elevate the needs of older adults. Representation through data is the key to practically enabling health equity. The AI/ML healthcare evolution will only achieve meaningful impact if the foundation is in data that is accurate, comprehensive, and scalable. In 2024, we need to see more investment and accountability in the use and application of data to truly serve the most vulnerable.

Christine Swisher, PhD, Chief Scientific Officer at Ronin

At Ronin, we are committed to developing and delivering safe, equitable, and effective machine learning systems and believe responsible AI use in healthcare demands a three-pronged approach:

1. Rigorous model validation to ensure high performance to prevent foreseeable issues.

2. Continuous performance monitoring to promptly detect changes in low-performing algorithms and drift early.

3. Rapid issue correction triggered by changes in performance, which involves root-cause analysis, data updates, and model retraining to uphold accuracy.

This strategy has helped our company foster trust between clinician users and our AI-driven platform and holds the potential to transform clinical outcomes, patient experiences, and reduce healthcare costs. Responsible AI paves the way for a future where technology and human expertise seamlessly collaborate to enhance patient well-being.

Robert Connely, Global Market Leader for Healthcare at Pega

With AI and technology more pervasively deployed in healthcare, there will be increasing pressure on healthcare AI vendors to address organization needs for AI model auditability – particularly due to the increase in AI regulations. Healthcare organizations will prioritize tracking and understanding the operations of AI models to ensure accurate decision-making, safeguarding patient data, and maintaining full transparency and accountability. As a result, the industry will move toward a more secure, transparent, and patient-centered era of healthcare delivery.

Douglas Grimm, Partner and Health Care Practice Leader at ArentFox Schiff LLP

As AI products continue to demonstrate the potential for operational efficiencies and cost savings, there will be increased use and speedy implementation. While an overall regulatory framework for AI is still under development, the use of AI will lead to increased data privacy and security scrutiny for providers. Both HIPAA and related state laws create strict guidelines and restrictions on collecting, using, and maintaining patient-protected health information.

Healthcare providers should be mindful of how an AI product addresses data privacy and security, particularly when integrating AI into the architecture of existing information systems. Litigation between providers and AI developers that market non-compliant or less stable products will undoubtedly arise as breaches and security incidents occur. The Office for Civil Rights, the federal agency responsible for HIPAA enforcement will monitor providers’ AI information platforms and take robust enforcement actions as warranted.

Joe Ganley, VP of Government and Regulatory Affairs at athenahealth

Why 2024 AI regulations in healthcare shouldn’t be a one-size-fits-all approach: The race to leverage AI in healthcare and other industries has brought a similarly strong interest in government regulation. However, looking for a single law to govern AI is a fundamentally wrong approach. In 2024, regulators should focus on AI’s role within specific use cases – not on the technology as a whole. Rather than having a single AI law, we need to see updates to existing regulations that utilize AI.

For example, if there is bias inherent in tools being used for hiring, the EEOC will step in and change the requirements. Like with any technology, AI is complex, so future regulation of this emerging technology should balance risk and benefits and be done in a thoughtful way that involves a broad cross-section of stakeholders. If we attempt to regulate AI too quickly, we will fail, but if done right, we will prevent harm and harness the enormous potential of this technology.

Frederico Braga, Head of Digital and IT at Debiopharm

I expect 2024 will emphasize the need to consolidate AI for multiple applications within the healthcare space, including enhanced detection of disease and identification of cancer cells. Companies will integrate various capabilities to deliver more streamlined point solutions to patients. As economic pressures loom, a big focus will also be on gaining efficiencies through the use of digital health devices.

From a biopharmaceutical industry perspective, I envision we will see the biggest impacts of AI through targeted identification within pre-clinical research. However, these impacts may be delayed due to the regulated nature of the activities, such as ICH E5 guidelines. I also foresee companies becoming better at understanding human biology and genetic mutation’s impact on target identification. In the regulatory space, I anticipate a quiet but pervasive adoption of AI to support activities such as writing meeting minutes and classifying patient profiles. These are mostly productivity-related tasks but will ensure clinical development professionals can focus on value-adding activities and efficiencies.

Jason Schultz, Partner at Barnes & Thornburg LLP

Generally, healthcare providers will become increasingly interested in artificial intelligence in 2024 due to the need to drive efficiency and profit margins during a period of increasing labor costs and flat or declining healthcare reimbursement. Simultaneously, regulatory barriers to entry will likely increase for healthcare AI technology as President Biden’s executive order mandates increased research, standardization, data collection, and safety testing. In addition to the federal government’s initiatives, more states will likely independently begin to regulate AI technology which will even further complicate AI technology development in healthcare. The battle between rapid innovation and safety will be the highlight of 2024.

Alison Sloane, General Manager, Vigilance Detect at IQVIA

In the coming year, we should expect to see an increased focus on patient-centricity within all facets of patient support and engagement. This acts as a catalyst for the application of artificial intelligence (AI) to address safety risk monitoring to free up healthcare professionals (HCPs) from administrative tasks while interacting with their patients. Applying mechanisms to detect safety risks such as adverse events (AEs), product quality complaints (PQCs) and off-label use is increasingly beneficial for optimizing patient centricity. Considering the increased advancement of AI and generative AI (GenAI), technology can be leveraged to auto-identify safety risks in audio files, AI agents, and live agent chat, all of which are a source for patient safety information.

Though it may be too early to expect any form of regulation this year regarding AI from governing bodies in life sciences, we all know it is coming. Those who already apply sound and established best practices within their workflows and any application of technology will be in a good position once regulations go into effect. Themes have been emerging from initial discussions and future regulations are anticipated to include:

• Human-led governance, accountability, and transparency: These practices would need to ensure increased transparency, detailing the use of AI, its development, and performance. It would also include measures to ensure the traceability and auditability of results procured from AI, meaning organizations would need to be able to reproduce or replicate those same results to show consistency and validity. Vendor oversight and control are also key topics such as monitoring and documenting results, corrective actions, and ensuring intended results are achieved.

• Data quality, reliability, and representativeness standards are also impacting how companies perform validation and verification of code and train their data sets. Requirements to ensure provenance, relevance, and replicability of data, and record trails to show its origin through to present place. Ensuring adequate data and consistent results will be a requirement and will most likely be brought into legislation.

Performance of models and their development and validation practices will likely be a requirement with regulations around measuring performance to ensure reliable and consistent results from a pharmacovigilance perspective. In addition, improved performance over time will be expected with practices in place for feedback, retraining, correction, and data reviews by governance. As the trend of AI continues to enter life sciences and impact patient support workflows and pharmacovigilance, there will certainly be a continued degree of augmented intelligence added to processes, with an element of human-in-the-loop remaining alongside any automation. For example, GenAI can be leveraged for data summarization and extraction facilitating current processing practices such as the detection of safety risks upstream of pharmacovigilance processing within patient support programs and also within the downstream data entry, quality control, and medical review with human pharmacovigilance expertise and oversight remaining.

Jens-Olaf Vanggaard, General Manager, Regulatory Technology at IQVIA

Today, the regulatory industry is looking at generative artificial intelligence as a golden hammer, with every issue perceived as a nail. However, this is not universally applicable. Certain regulatory challenges demand an alternative approach; just as a screw requires twisting rather than hitting, problems may require solutions beyond generative AI. We will see this become evident in 2024 as organizations recognize the capabilities of the tools already at their disposal.

Increasingly, life science organizations are turning toward automation for their regulatory processes, but the industry will not be fully reliant on automated processes in the coming year. Mechanical aspects of the regulatory process will be automated, such as data entry and document processing, but regulatory professionals, the “human in the loop,” will be necessary for content review and finalization.

In 2024, organizations will embark on a period of exploration and testing. This will involve evaluating the effectiveness of different approaches to regulatory processes.

Erik Littlejohn, CEO at CloudWave

Navigating the opportunities, challenges, and cybersecurity risks of AI in healthcare. As the healthcare industry continues to embrace the transformative power of AI, there will be exciting opportunities and formidable challenges. CIOs and healthcare executives will need to simultaneously understand how to harness the potential of AI while safeguarding against emerging cybersecurity threats.

AI is no longer confined to a niche but has become a boardroom topic, with CIOs facing the inevitable question of their organization’s AI strategy. The more prominent players in the industry have the financial might to make substantial investments in AI, positioning themselves as early adopters, while others may find themselves relying on vendors to stay competitive. CIOs must be equipped to convey how their chosen vendors are addressing the challenges and opportunities presented by AI.

On the other hand, concerns are raised about the malicious use of AI in cyber attacks. Beyond conventional threats like ransomware, there is a new frontier where threat actors leverage AI to craft more sophisticated spear-phishing emails. The ability of AI to quickly parse stolen data and launch targeted attacks poses a significant challenge to cybersecurity efforts.

Questions about the security of AI tools used by clinicians, especially those handling protected health information (PHI), will become a key area of focus. Ensuring these tools meet stringent security standards is crucial for maintaining patient trust and compliance with privacy regulations. In 2024, healthcare organizations must adopt a multifaceted approach to AI security to navigate this evolving threat landscape. This includes safeguarding against external threats and scrutinizing the AI tools integrated into internal processes.

Ty Greenhalgh, Industry Principal, Healthcare at Claroty

Today, AI is the dumbest it will ever be. The rapid pace of AI development and adoption in the healthcare sector will leave providers extremely vulnerable to cyberattacks in 2024. If the industry does not take the proper precautions to implement robust security protocols throughout the AI adoption and deployment stages, bad actors will capitalize on these new attack surfaces. Gaining access to hospital BMS or patient care systems can impact operations, patient care, or worse — potentially putting lives at risk.

More in News

The role of hospitality staffing agencies has become increasingly essential in assisting businesses to address the challenges presented by a dynamic and rapidly changing industry. As the hospitality sector experiences fluctuating demand and seasonal peaks, these agencies are stepping in to provide skilled professionals who can seamlessly fill short-term gaps or assist during high-demand periods. Through innovative recruitment strategies and enhanced digital platforms, agencies are offering faster and more efficient staffing solutions that meet the diverse needs of hotels, restaurants, event venues, and more. The advanced systems make the hiring process more efficient, reducing the time spent finding qualified staff and improving the match between employers and employees. Many hospitality staffing agencies are emphasizing flexibility and adaptability, offering both temporary and permanent staffing options that allow businesses to scale their workforce quickly. With a growing focus on employee training and retention, these agencies are not just filling positions; they are contributing to the long-term success and stability of the hospitality industry. What Makes Staffing Agencies Essential for Businesses? Staffing agencies have become an essential partner for businesses seeking to maintain flexibility and efficiency in their workforce. One of the key benefits they offer is the ability to quickly scale up or down in response to market demand or seasonal fluctuations. Staffing agencies manage the labor-intensive tasks of recruitment, screening, and interviewing, which allows businesses to concentrate on their primary operations without the additional strain of managing the hiring process independently. Staffing agencies can gain access to a pool of talent that might otherwise be unavailable through traditional hiring methods by utilizing their networks and industry expertise. This helps businesses find the right employees faster and with less effort, reducing the risk of turnover and improving overall productivity. As industries continue to evolve, staffing agencies are becoming indispensable, helping companies stay agile and competitive in a fast-changing workforce landscape. How Will Hospitality Staffing Agencies Evolve in the Future? Technological progress and a move towards personalized services will shape the future of hospitality staffing agencies. The future of hospitality staffing agencies will be shaped by technological advancements and a move towards more customized services. With the continued progress of AI and data analytics, agencies will be able to optimize the recruitment process, providing quicker and more precise matches between job seekers and employers. Automation will help eliminate administrative tasks, allowing staffing agencies to focus on key areas like cultural fit and long-term employee development, improving both the efficiency and quality of hires. As the hospitality industry evolves, agencies will need to address the demand for specialized workers. As new trends and customer expectations emerge, staffing agencies will be essential in providing employees who are adaptable and knowledgeable in sustainability and technology. The rise of remote work will push agencies to offer more flexible staffing options, ensuring that businesses can meet both on-site and virtual workforce needs. By embracing these changes, hospitality staffing agencies will continue to be vital in helping businesses stay competitive and resilient. ...Read more
The management of illegal financial operations, especially money laundering, is becoming more difficult throughout Latin America as financial institutions there continue to develop and expand. This problem jeopardizes the integrity of entire economies in addition to the soundness of financial institutions. As a result, companies and government agencies are using artificial intelligence (AI) to create more effective, scalable methods of identifying and stopping money laundering. AI is a potent weapon in the battle against financial fraud in Latin America because of its capacity to process enormous volumes of data and spot intricate patterns. How Do AI-Driven Detection Systems Improve Regulatory Compliance? In recent years, anti-money laundering (AML) regulatory regimes have tightened in numerous Latin American nations. Financial institutions must put in place reliable mechanisms for tracking transactions and reporting questionable activity in order to abide by these rules. AI-powered solutions have become a vital resource for these businesses in successfully fulfilling regulatory obligations. Real-time transaction data analysis by machine learning algorithms might identify potentially troubling patterns that human analysts might overlook. By continuously learning from fresh data, these algorithms make sure that their detection capabilities are up to date and efficient in spotting new money laundering schemes. Financial institutions in Latin America are therefore better able to abide by national and international laws while lowering their risk of facing severe fines. AI’s role in risk assessment and ongoing monitoring is another key area that contributes to fighting money laundering. Traditionally, financial institutions relied on manual processes and static risk models to assess clients and transactions. These methods, while valuable, often fail to keep pace with increasingly sophisticated money laundering schemes. AI enables a more dynamic and responsive approach by utilizing advanced algorithms to analyze a broader range of data sources. For example, AI models can assess customer behavior, transaction histories, and even external factors like geopolitical events to determine the likelihood of money laundering activities. What is the Role of AI in Cross-Border Collaboration and Information Sharing? The fragmented approach to financial regulation in Latin America presents a unique difficulty in the fight against money laundering. Every nation has its own rules, and transferring information across borders is either sluggish or ineffective. By enabling real-time collaboration and data exchange between institutions, both domestically and internationally, artificial intelligence is significantly helping to break down this barrier. Institutions may more effectively coordinate regional efforts to combat money laundering by using AI-powered systems to securely and promptly share insights about suspicious activity. As a result, the financial ecosystem becomes more open and integrated and is less susceptible to illegal financial flows. In Latin America, the use of artificial intelligence in the battle against money laundering is revolutionizing the field. AI is positioned as a vital tool in tackling the region's financial crime issues due to its capacity to improve detection skills, risk assessments, and cross-border collaboration. AI will become more and more crucial in preserving the integrity of Latin American financial systems and promoting regional economic stability as it develops. ...Read more
Data quality monitoring is the process of measuring and reporting on changes in data quality dimensions and issues. It includes responsibilities such as data evaluation, measurement, and management of data for correctness, consistency, and reliability, as well as the use of various methodologies to discover and resolve data quality issues. Monitoring assists in identifying data quality concerns early on, before they escalate into a serious problem that affects application performance or business operations.  What are the Key Data Quality Monitoring Techniques? Data auditing serves as the first step, reviewing datasets to identify errors, gaps, or inconsistencies. Data cleansing then addresses these issues by correcting inaccuracies, removing duplicates, and standardizing formats to ensure the information is trustworthy. Data profiling complements this by analyzing patterns, relationships, and anomalies within the data, providing a clear understanding of its structure and health. Tracking data quality metrics provides measurable insights into trends, improvement areas, and the overall effectiveness of quality initiatives. Establishing data quality rules sets clear criteria for accuracy, completeness, and consistency, automatically flagging records that do not meet these standards. Ingesting the data carefully is another crucial step, ensuring that information entering systems is accurate and properly formatted from the start. Metadata management helps track the context and lineage of data, providing teams with visibility into its origin, usage, and transformations. Data performance testing evaluates system efficiency in processing and maintaining high-quality data under varying conditions. What Advantages Does Data Quality Monitoring Offer? Data quality monitoring offers significant advantages by ensuring that information within an organization is accurate, consistent, and reliable. When data is well-monitored and maintained, implementing new systems or processes becomes much simpler, as clean and standardized data reduces errors and integration challenges. This enhancement boosts the efficiency of business operations, enabling teams to concentrate on strategic initiatives instead of rectifying preventable errors. High-quality data directly strengthens customer relationships by enabling more personalized, timely, and relevant interactions. Accurate insights help businesses understand customer needs better, anticipate preferences, and deliver services that build trust and loyalty. Additional benefits include better compliance with regulatory requirements, increased collaboration among teams, and the capability to reveal new insights that promote innovation. Data quality monitoring turns information into a powerful asset, supporting sustainable growth and competitive advantage. ...Read more
ERP systems have now become an essential tool for companies that are active in Latin America, as the companies in this region deal with multiple markets, varying regulatory frameworks, different currencies, different tax systems, and varied supply chains. The solutions for the implementation management of SAP could be a good choice for such organizations. Implementation, which is effectively managed, does not merely concern the application of technology. Implementation is about aligning the objectives of the business and its processes to help organizations develop their consistent digital backbone, which will also provide them with the required flexibility for local needs. Implementation management has become an essential component of corporate transformations. Aligning ERP Strategy with Regional Business Needs The initial success of the implementation process lies in the knowledge of the operation of the company’s business in various Latin American markets. Finance, procurement, sales, production, stock management, and HR follow common corporate policies. However, each of these functions might still have different configurations depending on the country where they will be used. Accounting, electronic invoices, statutory reporting, taxes, and payments could differ from one jurisdiction to another. The process of business process evaluation is yet another crucial step. Companies may take a look at the processes that are already in place, find out which of them are performed manually, study duplicate processes and decide where process standardization would help make things better. Instead of moving all the processes to a new environment, implementation teams would have an opportunity to analyze which processes contribute to achieving business goals and which need to be changed. Effective regional execution also calls for effective governance. Organizations could include corporate executives, regional business teams, finance experts, technologists, and even implementation specialists from outside. Well-defined roles could facilitate decision-making and avoid conflicting demands. Effective governance also helps in setting standards for scope management, approval, documentation, risk management, and communication in implementation projects. Managing Data Integration and Change Effectively The quality of the data will directly affect the value of the enterprise system that an organization gets. While implementing, companies will have to consolidate information that is present in several legacy systems, spreadsheets, databases, and operating systems. Information on customers, suppliers, products, finance, and inventory needs to be checked before migrating. Cleansing and validation of the data will ensure duplication avoidance and accuracy, while the owner of the data will take care of the quality postimplementation. Integration is just as critical since enterprise systems rarely function alone. The firm might have to integrate its systems with banking software, tax systems, client programs, warehousing systems, manufacturing systems, payroll, and many other business applications. Proper integration management needs clear data flow, technical standards, security controls, and testing methodologies. An effective integration strategy could go a long way in ensuring there is no isolated information and that departments have consistent data. “An effective integration strategy could go a long way in ensuring there is no isolated information and that departments have consistent data.” Change management is yet another important factor that needs to be considered. There may be a need for staff to follow different ways of working, new responsibilities, approvals, and reporting. Training must be conducted for all the activities performed in the job, rather than only the functions of the system. Communication can help in explaining the reasons behind the change in process, new responsibilities, and sources of help for the staff. Business users’ involvement can help in this regard as well. Strengthening Performance through Continuous Optimization Implementation is not considered complete upon the going live of the system. Support mechanisms are required for organizations to effectively measure performance, troubleshoot any issues, assess user feedback, and optimize processes. Performance monitoring at an early stage can reveal transaction errors, integration issues, reporting gaps, or even configuration issues that might have an impact on business operations. Analytics will also be able to add another dimension of value post-implementation. Information that is integrated can be analyzed to get insights into the financial performance, buying behavior, inventory, sales activities, manufacturing efficiencies, and many other metrics. This could then assist managers in comparing their performance relative to other units/markets. Scalability is another component that needs to be considered during the implementation process. Companies could venture into other markets, introduce more products, buy other businesses, or even reorganize their corporate structures. Flexibility on the enterprise platform, along with proper governance, can ease future modifications. Reviews can be done for automation of routine tasks, optimization of workflow processes and better reporting. SAP Implementation management solutions are able to serve as an organized framework for Latin American companies striving to achieve more connectivity within their operations. For them to be successful, it is necessary not only to set up appropriate technologies but also to take into consideration regional requirements, design processes, data quality, integration, adoption by employees, governance, and constant improvements. When enterprise technology is viewed as a business management solution and not just a technology project, it allows setting up more solid operational ground and creating a system that will enable making better decisions, implementing efficient processes, achieving sustainable growth in various markets, and increasing accountability. ...Read more