Key Capabilities for Intelligent Document Processing Platforms

By Massimo Ruffolo on July 21, 2022

There is a growing buzz about the transformative data opportunities that Intelligent Document Processing (IDP) can bring to businesses.

Gartner report that the IDP market is growing more than 100% a year and is projected to reach $5.4 billion in 2024 with enterprises realising cost efficiencies and dramatically improved processing capabilities.

Defining the IDP market, in its first report specifically focused on Intelligent Data Processing solutions, Gartner states that: “Intelligent document processing (IDP) solutions extract data to support automation of high-volume, repetitive document processing tasks and for analysis and insight.

“IDP uses natural language technologies and computer vision to extract data from structured and unstructured content, especially from documents, to support automation and augmentation”.

Easily adapted

IDP platforms are therefore distinct from other document processing products in that they enable the processing of documents created exclusively for humans, as well as those for machines; they can adapt — or be easily adapted — to formats not previously processed; and they extract data in various models.

“As such, organizations can transfer document processing work currently done by people and other machines (where automation is the goal) to IDPs”.

Enterprises and SMEs from industry sectors such as banking, insurance, retail, utilities and securities are in prime position to benefit from “significantly reduced processing time for documents and reduced errors from manual processing”.

Altilia is at the forefront of this movement to transform data processing providing the groundbreaking capabilities required to address new use cases and customer needs that require more functional depth and better user experience.

Critical Capabilities

Here are some of the critical capabilities that an IDP platform needs to be successful – and how Altilia technology supports its clients:

No-code/low-code easy to manage solution

  • An IDP platform needs to be designed for a business user to easily manage the system without the need for expensive IT department support.
  • Stakeholders from across your organization should be able to build and easily customize AI skills and workflow templates in order to streamline business specific functions.
  • Advanced security and user profiling processes, protecting information and ensuring that the right access and authentication is in place and no risk of data spills or breaches.

End-to-end document processing capabilities

  • Ability to apply a selection of pre-trained AI models, skills and packages.
  • Availability of a dedicated UI for document ingestion and document labelling.
  • Ability to fine-tune and customize AI models and skills with a simplified UI for document labelling and annotation.
  • A seamless experience to process documents and train AI models, as opposed to managing different data, sources and processes in separated ‘silos’.

Data extraction and classification from any type of document and format

  • Everything from pdfs to Word or Excel and handwritten or natural language documents can be analysed. And even faxes where they are still in use.
  • Items such as charts or signatures, which are designed to be read by humans, can be examined and the key data extracted, reducing manual time and errors.
  • Ability to process and extract data from long or complex documents with multiple non-standardized layouts (eg. Annual reports, financial statements, sustainability reports).
  • Continuous learning and human feedback when needed
  • The platform is able to learn and optimize AI models over time to improve performance and accuracy.
  • The platform provides Human-In-The-Loop (HITL) review workflows to take advantage of human feedback when needed to eliminate errors and improve accuracy.

Embedded decision intelligence capabilities

  • Ability to enrich documents with all the information extracted by AI models, to get the maximum value from unstructured data.
  • Keyword and semantic search engine capabilities to discover action insights ‘buried in’ long complex documents.

Advanced document-intensive process automation capabilities

  • Availability of hybrid AI methods to automate tasks that require human-level precision.
  • Capability to eliminate manual, error-prone and often repetitive tasks to reduce costs, improve process efficiency and trigger error-free responses.
  • Ability to compare extractions from one document to another, looking for deviations and similarities in order to process actions such as mortgage applications where data comes from different sources.

Interoperability

  • Alitalia’s platform can eliminate the pain of interoperability issues and plug in to the customers digital ecosystem and work with other business applications – without the need for costly engineering integration work.
  • Uses extensive set of connectors to exchange data and interact with Enterprise Resource Planning (ERP), Content Management System (CMS) and Customer Relationship Management (CRM) applications.
  • Feed 3rd party Enterprise Content Management (ECM) and Business Intelligence (BI) applications with metadata to enhance their capabilities.

Cloud-Ready Solution

  • The shift to the cloud brings huge advantages in computing capability and flexibility and Altilia’s platform works seamlessly in cloud environments.
  • Our SaaS solution offers SMEs the same performance as for large Enterprises and ensure that time-consuming processes can be handled in an automated way.
  • Capability to run workflows without the need to develop complex AI Ops or hire qualified IT experts.

Altilia Intelligent Automation provides all of the key capabilities required for an IDP platform and continues to develop features and benefits rapidly with its top-level team of scientists and engineers.

In upcoming articles, we will go deeper on the key capabilities required and demonstrate how Altilia’s IDP platform can transform your organization.

For more information on how we can support you, contact Altilia here.

By Massimo Ruffolo on July 21, 2022

Explore more stories like this one

Altilia is recognized as Major Player in the 2023-2024 IDC MarketScape Worldwide Intelligent Document Processing Vendor Assessment

Altilia, as a leading innovator in the field of Intelligent Document Processing (IDP), is proud to announce it has been recognized as a Major Player in the IDC MarketScape: Worldwide Intelligent Document Processing Software 2023–2024 Vendor Assessment (doc # US49988723, November 2023). We believe this acknowledgment represents yet another milestone for Altilia, reaffirming its position as a leader in the ever-evolving landscape of Intelligent Document Processing technology. With a dedicated team of over 50 highly experienced AI professionals, including scientists, researchers, and software engineers, Altilia aims to democratize the use of AI to help enterprises automate document-intensive business processes. As we celebrate this recognition from the IDC MarketScape, Altilia will continue its efforts to shape the future of document processing, bringing cutting-edge solutions to the forefront of the IDP market, and offering organizations unparalleled efficiency, automation, and knowledge management capabilities. About IDC MarketScape: IDC MarketScape vendor assessment model is designed to provide an overview of the competitive fitness of ICT (information and communications technology) suppliers in a given market. The research methodology utilizes a rigorous scoring methodology based on both qualitative and quantitative criteria that results in a single graphical illustration of each vendor’s position within a given market. IDC MarketScape provides a clear framework in which the product and service offerings, capabilities and strategies, and current and future market success factors of IT and telecommunications vendors can be meaningfully compared. The framework also provides technology buyers with a 360-degree assessment of the strengths and weaknesses of current and prospective vendors.

Read more

How the technology behind Chat GPT can work for your organization

The explosion of interest and publicity in Artificial Intelligence in recent months has come from the advent of Large Language Models, specifically OpenAI’s ChatGPT, which set the record for the fastest-growing user base in January. Suddenly it seems like everyone is fascinated by the coming surge of AI with new applications, creating excitement and fear for the future. When Google’s so-called “Godfather of AI” Dr Geoffrey Hinton warned about “quite scary” dangers, it made headlines around the world. Behind the hype So, it is important to understand what is behind the hype and see how it works and what your organization can use to build future value. This blog is split into two: first we learn about Natural Language Processing, the branch of computer science concerned with giving machines the ability to understand text and spoken words in much the same way humans can. And then we will go deeper on Large Language Models (LLMs), which is what ChatGPT and others like Google’s Bard are using. NLP combines computational linguistics with statistical, machine learning, and deep learning models to enable computers to process human language in the form of text or voice data and to ‘understand’ its full meaning, complete with the speaker or writer’s intent and sentiment. NLP drives computer programs that translate text from one language to another, respond to spoken commands, and summarize large volumes of text rapidly—even in real time. There’s a good chance you’ve interacted with NLP in the form of voice-operated GPS systems, digital assistants, speech-to-text dictation software, customer service chatbots, and other consumer conveniences. But NLP also plays a growing role in enterprise solutions that help streamline business operations, increase employee productivity, and simplify mission-critical business processes. There are two sub-fields of NLP: Natural Language Understanding (NLU) uses syntactic and semantic analysis of text and speech to determine the meaning of a sentence, similarly to how humans do it naturally. Altilia uses Large Language Models for this. Natural Language Generation (NLG) enables computers to write a human language text response based on data input. ChatGPT uses LLMs for NLG. Large Language Models (LLMs) LLMs are a relatively new approach where massive amounts of text are fed into the AI algorithm using unsupervised learning to create a “foundation” model, which can use transfer learning to continually learn new tasks. The key is using huge volumes of data. The training data for ChatGPT comes from a diverse set of text sources, including billions of web pages from the internet, a huge number of books from different genres, articles from news websites, magazines and academic journals and social media platforms such as Twitter, Reddit and Facebook to learn about informal language and the nuances of social interactions. The model is then able to predict the next word in a sentence and generate coherent text in a wide range of language tasks. Altilia does exactly the same, but uses this capability to provide enterprise tools for specific business use cases. Technology breakthrough Overall, NLP is the core technology to understand the content of documents. LLMs are a breakthrough in the field as they allow a shift from where an NLP model had to be trained in silos for a specific task to one where LLMs can leverage accumulated knowledge with transfer learning. In practice, this means we can apply a pre-trained LLM and fine-tune it with a relatively small dataset to allow the model to learn new customer-specific or use-case specific tasks. We are then able to scale up more effectively, it can be applied more easily for different use cases, leading to a higher ROI. For more information on how Altilia Intelligent Automation can support your organization to see radical improvements in accuracy and efficiency, schedule a demo here.

Read more

Leveraging GPT and Large Language Models to enhance Intelligent Document Processing

The rise of Artificial Intelligence has been the talk of the business world since the emergence of ChatGPT earlier this year. Now executives around the world find themselves in need of understanding the importance and power of Large Language Models in delivering potentially ground-breaking use cases that can bring greater efficiency and accuracy to mundane tasks. Natural Language Generation (NLG) enables computers to write a human language text response based on human generated prompts. What few understand is that there is still a deep flaw in the ChatGPT technology: up to 20-30% of all results have inaccuracies, according to Gartner. What Gartner have found is that ChatGPT is “susceptible to hallucinations and sometimes provides incorrect answers to prompts. It also reflects the deficiencies of its training corpus, which can lead to biased or inappropriate responses as well as algorithmic bias.” To better understand this, it’s key to consider how LLMs work: hundreds of billions of pieces of training data are fed into the model, enabling it to learn patterns, associations, and linguistic structures. This massive amount of data allows the model to capture a wide range of language patterns and generate responses based on its learned knowledge. However, as vast training data can be, the model can only generate responses as reliable as the information it has been exposed to. If it encounters a question or topic that falls outside the training data or knowledge cutoff, responses may be incomplete or inaccurate. For this reason, and to better understand how best to use LLMs in enterprise environments, Gartner outlined a set of AI Design Patterns and ranked them by difficulty of each implementation. We are delighted to share that Altilia Intelligent Automation already implements in its platform two of the most complex design patterns: LLM with Document Retrieval or Search This provides the potential to link LLMs with internal document databases, unlocking key insights from internal data with LLM capabilities This provides much more accurate and relevant information, reducing the potential for inaccuracies due to the ability to the use of retrieval. Fine-tuning LLM The LLM foundation model is fine-tuned using transfer learning with an enterprise’s own documents or particular training dataset, which updates the underlying LLM parameters. LLMs can then be customized to specific use cases, providing bespoke results and improved accuracy. So, while the business and technology world has been getting excited by the emergence of ChatGPT and LLMs, Altilia has already been providing tools to enterprises to leverage these generative AI models to their full potential. And by doing so, thanks to its model’s fine-tuning capabilities, we are able to overcome the main limitation of a system like OpenAI’s ChatGPT, which is the lack of accuracy of its answers. For more information on how Altilia Intelligent Automation can help your organization, schedule a free demo here.

Read more