{"id":21661,"date":"2026-03-04T06:23:00","date_gmt":"2026-03-04T06:23:00","guid":{"rendered":"https:\/\/sawahsolutions.com\/lap\/colombian-supreme-courts-ai-detection-clash-highlights-flaws-in-automated-legal-scrutiny\/"},"modified":"2026-03-04T06:44:36","modified_gmt":"2026-03-04T06:44:36","slug":"colombian-supreme-courts-ai-detection-clash-highlights-flaws-in-automated-legal-scrutiny","status":"publish","type":"post","link":"https:\/\/sawahsolutions.com\/lap\/colombian-supreme-courts-ai-detection-clash-highlights-flaws-in-automated-legal-scrutiny\/","title":{"rendered":"Colombian Supreme Court&#8217;s AI detection clash highlights flaws in automated legal scrutiny"},"content":{"rendered":"<p><\/p>\n<div>\n<p>Colombia\u2019s Supreme Court faced a paradox when its own AI detection tools flagged its ruling as largely AI-generated, exposing the limitations and reliability issues of current forensic AI technologies in legal proceedings.<\/p>\n<\/div>\n<div>\n<p>Colombia\u2019s Supreme Court has dismissed a cassation appeal after concluding the filing was produced with the aid of generative artificial intelligence, only to have that conclusion swiftly undercut when the same detection software flagged the court\u2019s own ruling as largely AI-written. According to the report by Decrypt, the court said it used the Winston AI tool to analyse the attorney\u2019s brief and found \u201conly 7% human content,\u201d prompting the dismissal as inadmissible. <sup><a target=\"_blank\" rel=\"nofollow noopener noreferrer\" href=\"https:\/\/decrypt.co\/359869\/colombian-court-rejects-appeal-for-ai-writing-then-gets-flagged-by-its-own-ai-detector\">[2]<\/a><\/sup><\/p>\n<p>Legal practitioners immediately began re\u2011testing the court\u2019s decision with the same and alternative detectors and shared results widely on social media. Attorney Emmanuel Alessio Velasquez posted that he ran the text of Auto AP760\/2026 through Winston AI and obtained a result showing \u201cthe document contains 93% AI-generated text.\u201d Other lawyers reported similar contradictions when scanning the ruling with GPTZero and comparable services, with outputs swinging from \u201c100% AI\u201d to \u201c100% human\u201d depending on the passage submitted. <sup><a target=\"_blank\" rel=\"nofollow noopener noreferrer\" href=\"https:\/\/decrypt.co\/359869\/colombian-court-rejects-appeal-for-ai-writing-then-gets-flagged-by-its-own-ai-detector\">[2]<\/a><\/sup><\/p>\n<p>The episode has focused attention on the technical limits of current AI\u2011detection tools. Experts point out these systems rely on statistical fingerprints such as predictability, sentence length and so\u2011called \u201cburstiness,\u201d characteristics that formal legal drafting, academic prose or writing by non\u2011native speakers often share with model output. That overlap produces false positives, a problem documented in academic work and repeated institutional experience. A 2023 Patterns study found many TOEFL essays by non\u2011native speakers were wrongly flagged as machine generated, and vendors including Turnitin have publicly acknowledged elevated false positive rates at low levels of AI content. OpenAI itself withdrew a public detection tool after persistent inaccuracies. Universities have disabled detector features following wrongful penalties and misclassifications. <sup><a target=\"_blank\" rel=\"nofollow noopener noreferrer\" href=\"https:\/\/decrypt.co\/359869\/colombian-court-rejects-appeal-for-ai-writing-then-gets-flagged-by-its-own-ai-detector\">[2]<\/a><\/sup><\/p>\n<p>Beyond the technical literature, practical incidents underline the stakes. Colombian courts have already grappled with cases of AI\u2011generated misinformation in legal filings; international incident trackers recorded a lawyer fined for submitting fabricated, AI\u2011sourced citations. The Supreme Court\u2019s recent decisions , including AC739\u20112026, where a lawyer was fined for citing nonexistent AI\u2011generated precedents in February, and AP760\u20112026 , are among the first regional judicial confrontations with generative AI misuse, but they also demonstrate how reliance on fallible detectors can produce contested outcomes. Critics noted that some detectors offer commercial \u201chumanisation\u201d services, creating a perceived conflict of interest when the same industry profits from correcting the problems its tools identify. <sup><a target=\"_blank\" rel=\"nofollow noopener noreferrer\" href=\"https:\/\/oecd.ai\/en\/incidents\/2026-02-16-d0ba\">[5]<\/a><\/sup><sup><a target=\"_blank\" rel=\"nofollow noopener noreferrer\" href=\"https:\/\/decrypt.co\/359869\/colombian-court-rejects-appeal-for-ai-writing-then-gets-flagged-by-its-own-ai-detector\">[2]<\/a><\/sup><sup><a target=\"_blank\" rel=\"nofollow noopener noreferrer\" href=\"https:\/\/marcasur.com\/en\/noticia\/a-historic-turning-point-colombias-supreme-court-overturns-a-ruling-based-on-non-existent-citations-and-warns-about-unverified-ai-use-5035%26f%3D-2025\">[7]<\/a><\/sup><\/p>\n<p>Colombia\u2019s judiciary has not been blind to these tensions. The Constitutional Court has emphasised the necessity of human oversight and has referenced UNESCO\u2019s Global Toolkit on AI and the Rule of Law when calling for transparent, accountable use of automated tools. The Superior Council of the Judiciary published formal guidelines in December 2024 (document PCSJA24\u201112243) permitting AI for administrative or support tasks but restricting its use in legal reasoning, evidence assessment and final decision\u2011making unless accompanied by explicit human validation and disclosure. That framework could be cited to challenge rulings that treat detector outputs as decisive proof of misconduct. <sup><a target=\"_blank\" rel=\"nofollow noopener noreferrer\" href=\"https:\/\/www.unesco.org\/en\/articles\/ai-courtroom-colombian-constitutional-courts-landmark-ruling-cites-unescos-ai-tools\">[3]<\/a><\/sup><sup><a target=\"_blank\" rel=\"nofollow noopener noreferrer\" href=\"https:\/\/ids.org.br\/en\/news-post\/in-a-new-ruling-colombias-constitutional-court-analyzes-the-use-of-ai-tools-by-the-countrys-judiciary\/\">[4]<\/a><\/sup><sup><a target=\"_blank\" rel=\"nofollow noopener noreferrer\" href=\"https:\/\/arizaymarin.com\/ruling-t-323-24-and-the-use-of-generativa-ai-in-colombias-judiciary\/\">[6]<\/a><\/sup><\/p>\n<p>Legal commentators say the episode illustrates both a policy and a practical problem: courts and lawyers need robust, verifiable standards before automated assessments can influence access to justice. Observers warn that unchecked detector reliance disproportionately harms those whose writing matches the statistical profiles detectors target , careful, repetitive or non\u2011native prose , risking wrongful denial of legal remedies. Several commentators argued that transparency about detector methodologies and independent validation are prerequisites to any forensic use in judicial processes. <sup><a target=\"_blank\" rel=\"nofollow noopener noreferrer\" href=\"https:\/\/decrypt.co\/359869\/colombian-court-rejects-appeal-for-ai-writing-then-gets-flagged-by-its-own-ai-detector\">[2]<\/a><\/sup><sup><a target=\"_blank\" rel=\"nofollow noopener noreferrer\" href=\"https:\/\/www.unesco.org\/en\/articles\/ai-courtroom-colombian-constitutional-courts-landmark-ruling-cites-unescos-ai-tools\">[3]<\/a><\/sup><\/p>\n<p>The controversy has prompted calls for caution rather than immediate prohibition. While courts must guard against fraudulent or misleading AI\u2011generated submissions, experts quoted in the coverage urge that technology be used only as an investigatory cue and never as a substitute for human appraisal. As Colombia\u2019s encounters with these questions multiply, the episode underscores a broader legal dilemma worldwide: how to integrate automation into adjudication without letting imperfect tools displace the human judgement that underpins due process. <sup><a target=\"_blank\" rel=\"nofollow noopener noreferrer\" href=\"https:\/\/decrypt.co\/359869\/colombian-court-rejects-appeal-for-ai-writing-then-gets-flagged-by-its-own-ai-detector\">[2]<\/a><\/sup><sup><a target=\"_blank\" rel=\"nofollow noopener noreferrer\" href=\"https:\/\/www.unesco.org\/en\/articles\/ai-courtroom-colombian-constitutional-courts-landmark-ruling-cites-unescos-ai-tools\">[3]<\/a><\/sup><\/p>\n<h3>Source Reference Map<\/h3>\n<p><strong>Inspired by headline at:<\/strong> <sup><a target=\"_blank\" rel=\"nofollow noopener noreferrer\" href=\"https:\/\/decrypt.co\/359869\/colombian-court-rejects-appeal-for-ai-writing-then-gets-flagged-by-its-own-ai-detector\">[1]<\/a><\/sup><\/p>\n<p><strong>Sources by paragraph:<\/strong><\/p>\n<p>Source: <a target=\"_blank\" rel=\"nofollow noopener noreferrer\" href=\"https:\/\/www.noahwire.com\">Noah Wire Services<\/a><\/p>\n<\/p><\/div>\n<div>\n<h3 class=\"mt-0\">Noah Fact Check Pro<\/h3>\n<p class=\"text-sm sans\">The draft above was created using the information available at the time the story first<br \/>\n        emerged. We\u2019ve since applied our fact-checking process to the final narrative, based on the criteria listed<br \/>\n        below. The results are intended to help you assess the credibility of the piece and highlight any areas that may<br \/>\n        warrant further investigation.<\/p>\n<h3 class=\"mt-3 mb-1 font-semibold text-base\">Freshness check<\/h3>\n<p class=\"text-sm pt-0 sans\"><span class=\"font-bold\">Score:<br \/>\n        <\/span>10<\/p>\n<p class=\"text-sm pt-0 sans\"><span class=\"font-bold\">Notes:<br \/>\n        <\/span>The article was published on March 4, 2026, and there are no indications of it being recycled or republished from other sources. The content appears original and timely.<\/p>\n<h3 class=\"mt-3 mb-1 font-semibold text-base\">Quotes check<\/h3>\n<p class=\"text-sm pt-0 sans\"><span class=\"font-bold\">Score:<br \/>\n        <\/span>8<\/p>\n<p class=\"text-sm pt-0 sans\"><span class=\"font-bold\">Notes:<br \/>\n        <\/span>The article includes direct quotes from attorney Emmanuel Alessio Velasquez and other legal experts. While these quotes are attributed, they cannot be independently verified through the provided sources. The lack of direct links to the original statements raises concerns about the authenticity of the quotes.<\/p>\n<h3 class=\"mt-3 mb-1 font-semibold text-base\">Source reliability<\/h3>\n<p class=\"text-sm pt-0 sans\"><span class=\"font-bold\">Score:<br \/>\n        <\/span>7<\/p>\n<p class=\"text-sm pt-0 sans\"><span class=\"font-bold\">Notes:<br \/>\n        <\/span>The primary source is Decrypt, a digital media company focusing on cryptocurrency and blockchain technology. While Decrypt is known for its coverage of technology-related topics, it is not a traditional news organisation. The article references statements from legal experts and attorneys, but without direct links to their original statements, the reliability of these claims is uncertain.<\/p>\n<h3 class=\"mt-3 mb-1 font-semibold text-base\">Plausibility check<\/h3>\n<p class=\"text-sm pt-0 sans\"><span class=\"font-bold\">Score:<br \/>\n        <\/span>9<\/p>\n<p class=\"text-sm pt-0 sans\"><span class=\"font-bold\">Notes:<br \/>\n    <\/span>The events described are plausible and align with ongoing discussions about the use of AI in legal proceedings. However, the lack of independently verifiable quotes and direct links to original statements diminishes the overall credibility of the claims.<\/p>\n<h3 class=\"mt-3 mb-1 font-semibold text-base\">Overall assessment<\/h3>\n<p class=\"text-sm pt-0 sans\"><span class=\"font-bold\">Verdict<\/span> (FAIL, OPEN, PASS): <span class=\"font-bold\">FAIL<\/span><\/p>\n<p class=\"text-sm pt-0 sans\"><span class=\"font-bold\">Confidence<\/span> (LOW, MEDIUM, HIGH): <span class=\"font-bold\">MEDIUM<\/span><\/p>\n<p class=\"text-sm mb-3 pt-0 sans\"><span class=\"font-bold\">Summary:<br \/>\n        <\/span>The article presents a timely and plausible account of a Colombian court&#8217;s decision regarding AI-generated content. However, the inability to independently verify the quotes and the reliance on a single source without direct links to original statements significantly undermine the credibility of the content. The lack of independent verification sources further diminishes the overall trustworthiness of the article.<\/p>\n<\/div>\n","protected":false},"excerpt":{"rendered":"<p>Colombia\u2019s Supreme Court faced a paradox when its own AI detection tools flagged its ruling as largely AI-generated, exposing the limitations and reliability issues of current forensic AI technologies in legal proceedings. Colombia\u2019s Supreme Court has dismissed a cassation appeal after concluding the filing was produced with the aid of generative artificial intelligence, only to<\/p>\n","protected":false},"author":1,"featured_media":21662,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[40],"tags":[],"class_list":{"0":"post-21661","1":"post","2":"type-post","3":"status-publish","4":"format-standard","5":"has-post-thumbnail","7":"category-london-news"},"amp_enabled":true,"_links":{"self":[{"href":"https:\/\/sawahsolutions.com\/lap\/wp-json\/wp\/v2\/posts\/21661","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/sawahsolutions.com\/lap\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/sawahsolutions.com\/lap\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/sawahsolutions.com\/lap\/wp-json\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/sawahsolutions.com\/lap\/wp-json\/wp\/v2\/comments?post=21661"}],"version-history":[{"count":1,"href":"https:\/\/sawahsolutions.com\/lap\/wp-json\/wp\/v2\/posts\/21661\/revisions"}],"predecessor-version":[{"id":21663,"href":"https:\/\/sawahsolutions.com\/lap\/wp-json\/wp\/v2\/posts\/21661\/revisions\/21663"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/sawahsolutions.com\/lap\/wp-json\/wp\/v2\/media\/21662"}],"wp:attachment":[{"href":"https:\/\/sawahsolutions.com\/lap\/wp-json\/wp\/v2\/media?parent=21661"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/sawahsolutions.com\/lap\/wp-json\/wp\/v2\/categories?post=21661"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/sawahsolutions.com\/lap\/wp-json\/wp\/v2\/tags?post=21661"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}