Skip to main content

Software Analyzing Texts?

By
Can software accurately analyze the writing style of an author to determine if he or she wrote a specific work? Maybe…
Open source app can detect text's authors
http://www.theregister.co.uk/2013/02/22/author_detection_uni_adelaide/
A group of Adelaide researchers has released an open-source tool that helps identify document authorship by comparing texts.

While their own test cases – and therefore the headlines – concentrated on identifying the authors of historical documents, it seems to The Register that any number of modern uses of such a tool might arise.

The two test cases the researchers drew on in developing their software, on Github here, were a series of US essays called The Federalist Papers, and the Letter to the Hebrews in the New Testament.

The Federalist Paper essays were written in the lead-up to the drafting of the US Constitution, by Alexander Hamilton, James Madison and John Jay. Of the 85 essays, the authorship of 12 is disputed and one has generally been attributed to Jay.

Professor Derek Abbott of the University of Adelaide explains the results: "We've shown that one of the disputed texts, Essay 62, is indeed written by James Madison with a high degree of certainty.

"But the other 12 essays cannot be allocated to any of the three authors with a similarly strong likelihood. We believe they are probably the result of a certain degree of collaboration between the authors, which would also explain why there hasn't been scholarly consensus to date."
I love research such as this. One of the problems we will face with online courses (and even traditional courses) is that students might be more tempted to submit the works of others as their own. You can buy almost anything online, including term papers and reports. What if software could flag works as questionable? That would be pretty valuable.

The challenge might be amassing sufficient amounts of verified text to establish a pattern, but we could always ask students to write a few short samples. Their online forum posts would also give us some sense of how a students writes when a grade isn't at stake.

The research and the software are both freely available.

Free software means there is a high likelihood that other scholars will test the software and the conclusions of the researchers. The more testing of the software, the more likely it will be improved. It might be reasonable to expect private industry and public agencies to also test the software.
In the research paper, published in full at PLOSOne, the group notes that author attribution is a question that's stretching beyond academia in the modern era.

http://www.plosone.org/article/info%3Adoi%2F10.1371%2Fjournal.pone.0054998
"Due to an increase in the amount of data in various forms including emails, blogs, messages on the internet and SMS, the problem of author attribution has received more attention. In addition to its traditional application for shedding light on the authorship of disputed texts in the classical literature, new applications have arisen such as plagiarism detection, web searching, spam email detection, and finding the authors of disputed or anonymous documents in forensics against cyber crime," the researchers write.

They note that further research would be needed to test their methodology against modern texts – but with the software offered for free, The Register can easily imagine the software getting a workout by any number of interested parties.
Free software? I know I'm curious enough to experiment with some public domain texts. After all, maybe Chaucer didn't write all those poems!
Labels:

Comments

Post a Comment

Popular posts from this blog

More Than a Typewriter: The Power of Word

By
Visalia Direct: Virtual Valley March 3, 2014 Deadline April 2014 Issue More Than a Typewriter: The Power of Word Typewriters still amaze me, especially the antique mechanical models. There’s something wonderful about the feel of levers, gears, springs and rollers working together to transmit thoughts into words. Typewriters possess a romance computer keyboards and touch screens lack. But, please, stop using your word processor like a typewriter. Word processor abuse mars many otherwise good documents. Bad habits people develop over time lead to documents that are ugly and difficult to edit and revise. The numerous excuses for improper word processing deserve dismissal. It does not take days or even hours to learn to use tabs effectively. Paragraph styles take minutes to understand and appreciate. Even a complex looking table of contents takes only a few mouse clicks to create if you construct a document properly. When you know more about your software tools, you also kno...
Post a Comment
Read more

eCheating: Students using high-tech tricks – USATODAY.com

By
This fall, I resorted to using "anti-plagairism" tools for the first time in at least six years. One reason for this is that what I had been teaching at the University of Minnesota didn't lend itself to plagiarism. My technical writing students had to design a new toy or board game, create a prototype, and develop a product pitch. It's hard to steal another person's LEGO project that uses randomly selected bricks. However, teaching a literature class I found that students either had problems with understanding citation norms or they simply assumed an instructor wouldn't check to determine if a passage was a copy-paste effort. I learned this is a great reason to have two mandatory drafts before a final paper, too. My department head and other colleagues were supportive and I'm now working on a reusable lesson module that will address citations. Student don't quite grasp that simply because you can copy-paste doesn't mean it is acceptable. ...
Post a Comment
Read more

Word Macro for Word Abusers

By
I overuse some words and phrases in my writing. Most writers have some problem words. It isn't that the words should never be used, or that we use them incorrectly. We simply use them too frequently. The following Microsoft Word VBA macro marks words I should check for overuse. Also included are words and phrases I should avoid. Feel free to copy and modify this macro. I encourage my students to try this macro, too. Once you have the macro in Word, you can alter the word list to reflect your preferences and habits. Sub macWordsToAvoid() Dim vFindText As Variant Dim txtWord As Variant 'list the exceptions to look for in an array vFindText = Array("about", "all", "almost", "a lot", "already", "always", "along with", _ "anxiously", "absolutely", "as well", "believe", "certainly", "clearly", "definitely", _ "eagerly",...
Post a Comment
Read more