Skip to main content

Software Analyzing Texts?

Can software accurately analyze the writing style of an author to determine if he or she wrote a specific work? Maybe…
Open source app can detect text's authors
http://www.theregister.co.uk/2013/02/22/author_detection_uni_adelaide/
A group of Adelaide researchers has released an open-source tool that helps identify document authorship by comparing texts.

While their own test cases – and therefore the headlines – concentrated on identifying the authors of historical documents, it seems to The Register that any number of modern uses of such a tool might arise.

The two test cases the researchers drew on in developing their software, on Github here, were a series of US essays called The Federalist Papers, and the Letter to the Hebrews in the New Testament.

The Federalist Paper essays were written in the lead-up to the drafting of the US Constitution, by Alexander Hamilton, James Madison and John Jay. Of the 85 essays, the authorship of 12 is disputed and one has generally been attributed to Jay.

Professor Derek Abbott of the University of Adelaide explains the results: "We've shown that one of the disputed texts, Essay 62, is indeed written by James Madison with a high degree of certainty.

"But the other 12 essays cannot be allocated to any of the three authors with a similarly strong likelihood. We believe they are probably the result of a certain degree of collaboration between the authors, which would also explain why there hasn't been scholarly consensus to date."
I love research such as this. One of the problems we will face with online courses (and even traditional courses) is that students might be more tempted to submit the works of others as their own. You can buy almost anything online, including term papers and reports. What if software could flag works as questionable? That would be pretty valuable.

The challenge might be amassing sufficient amounts of verified text to establish a pattern, but we could always ask students to write a few short samples. Their online forum posts would also give us some sense of how a students writes when a grade isn't at stake.

The research and the software are both freely available.

Free software means there is a high likelihood that other scholars will test the software and the conclusions of the researchers. The more testing of the software, the more likely it will be improved. It might be reasonable to expect private industry and public agencies to also test the software.
In the research paper, published in full at PLOSOne, the group notes that author attribution is a question that's stretching beyond academia in the modern era.

http://www.plosone.org/article/info%3Adoi%2F10.1371%2Fjournal.pone.0054998
"Due to an increase in the amount of data in various forms including emails, blogs, messages on the internet and SMS, the problem of author attribution has received more attention. In addition to its traditional application for shedding light on the authorship of disputed texts in the classical literature, new applications have arisen such as plagiarism detection, web searching, spam email detection, and finding the authors of disputed or anonymous documents in forensics against cyber crime," the researchers write.

They note that further research would be needed to test their methodology against modern texts – but with the software offered for free, The Register can easily imagine the software getting a workout by any number of interested parties.
Free software? I know I'm curious enough to experiment with some public domain texts. After all, maybe Chaucer didn't write all those poems!

Comments

Popular posts from this blog

Digital Writing Ideas

Online composition and participation are always a requirement in the courses I teach. When I began teaching at Fresno State as a graduate student in 2004, I was one of the few instructors who required students use Blackboard on a weekly basis. I believe there are several reasons to use tools like Blackboard / WebVista: Students can read and respond to the thoughts of their classmates. I have a record of how writing (and thinking) improve during a semester Peer editing can occur online, in small groups. Students less vocal in class discussions tend to participate more online. Normally, I post a " Weekly Response Question/Topic " based on class discussions during the week. Students can then extend the in-class discussion online. Those who were unable to speak up during the class have time to reflect and post their thoughts, too. By requiring every student to post at least 50 to 100 words a week, they soon engage each other in discussion. I always use threaded discussions...

Human Readers for Tests

As readers of my blogs know, I'm never opposed to using technology when it is an effective tool. I am opposed to the blind embrace of the latest trends without critical examination of the potential side effects. Computer-assisted grading, I can endorse to some extent because I use software to help me analyze student papers — and my own writings. But, I cannot and will not endorse any system that gives weight to the computer-based scoring. If you're a teacher, consider this petition: http://humanreaders.org/petition/index.php Now, I also want to add a critical comment on human graders. If the graders of standardized tests are using rigid scoring rubrics, they are little better than software algorithms. Bad grading is bad grading. Inflexible = bad. Again, I am not opposed to using a computer for fact checking, some plagiarism verification, and as formatting aids. Computers can and do help many of us write more effectively. But, I don't use computers to grade pape...

Podcasts and Internet Radio

You must read Podcasting News if you are interested in podcasts! The New York Times has NYTimes Podcasts covering almost every area of interest. For anyone and everyone, podcast.net is a directory of professional and amateur podcasts. Unfortunately, many podcasts come and go too quickly and the directory links to some ghost sites. For October 30, 2007, we were instructed: In your blog: listen to some podcasts and analyze different aspects of the production quality of these podcasts; then, reflect on ways that you could use writing to create podcasts or coursecasts; brainstorm some ideas for creating your own podcast: an interview, presentation... I am a fan of Internet Radio, podcasting, and pretty much all things resembling "radio" in any form. For November 6, we have been asked to create a podcast of some form, and I certainly don't see a problem creating a theatrical production of some sort. Podcasting has the convenience that most Web tools lack. A podcast ...