Blog

January 22, 2024

Man with robot analyzing documents
Robot helps man analyze a research paper. AI-generated image via Bing.


Update 36. 9:03pm. Back in December I was sent a 180-page research document, which I had to review and gather insights. In the interest of time (and sanity), I fed the document into Google Bard and ChatGPT.

ChatGPT (3.5 version) was not able to process my prompt stating that it could not access the file from my Google Drive folder. Google Bard, meanwhile, was able to access it, provide a summary, generate an analysis and provide recommendations. I followed through with prompts asking how it was able to generate the output and what were its sources.

Aside from the document itself, it also accessed other online sources to come up with a more holistic output.

I also conducted my own cross-validation by manually going through the document and determining the accuracy of Bard's findings.

While I am using the output in my report (and openly declaring that generative AI helped with the content), I remain skeptical with the veracity, correctness and completeness of AI's results. Part of my due diligence when seeking help from AI is to do my own review to cross-check its output. But only time will tell, when GAI will be so much better than it is now analyzing documents and providing insights.