There is quite a bit of talk about plagiarism in the news, especially in academia. The challenge of ensuring originality in academic, literary, and professional compositions is more pressing than ever. This is where "Detecting Plagiarism Using OpenText Knowledge Discovery (IDOL)" steps into the limelight, offering a compelling exploration of how advanced technology can be harnessed to safeguard intellectual property. At the heart of this innovative approach is the concept of document fingerprinting, a technological marvel that forms the bedrock of OpenText Analytics IDOL's plagiarism detection capabilities.

Document fingerprinting

Document fingerprinting is a technique used in computer science, particularly in the field of information security and data analysis. It involves creating a unique identifier or "fingerprint" for a document or a set of documents. This fingerprint is usually a concise representation that captures the essence of the document's content. The concept is analogous to human fingerprints, which uniquely identify individuals.

When documents are ingested into OpenText Knowledge Discovery (IDOL), the fingerprint_string lua function generates a list of fingerprints from the content of the document. Examples of fingerprints on document content are shown in the image below.

Document fingerprints generated on Wikipedia content

Classification

Once fingerprints of the original works are created, it simplifies the process of verifying if the content in question contains plagiarism. This involves creating fingerprints for the content under review and then comparing these against a database indexed with the original works. If there is a match indicating plagiarism, the content can then be categorized as plagiarized.

To see a demonstration of this function, please watch the following video.

Content acquisition

The content acquisition can happen using OpenText Knowledge Discovery (IDOL)'s Connectors, which can acquire content from 82 different content repositories. Content can also be OCR from old scanned PDFs or even images so as to provide a holistic search capability.

For a deeper understanding of these advancements or to discuss potential collaborations, please feel free to explore Opentext's overview on AI text analytics or email me at vjoseph@opentext.com.

More Information  

Learn more about what Unstructured Data Analytics can do for you.

Join OpenText on LinkedIn and follow @OpenText on X.

We’d love to hear your thoughts on this blog. Comment below.

The OpenText Analytics & AI team