Skip to main content

Week 10: More Assessment Results & Great News!

This week I continued the group mentions assessment with the researchers in PRINT. Thanks to Casey, this assessment had 8 mentions which meant the researchers were tasked with a somewhat difficult letter. Here is an example of the letter below:

16158 - George Shaw, Bickerstaffe, Lancashire, England to Phineas Pemberton, Pennsylvania, June 16, 1684 

"...Dear PP I rcd [received] thy dated ye 27h of the 9h mo: 83 in which I was glad

to hear of your wellfare: freinds are generaly well hear

a way the last assizes the judge gave in charge they must put

the laws in exemption aganst desenters: Justices [Entwistle?/Entwhistle?] &

[Haith?] sent warrants to seeke for conventikles meetings ye offecers are prity sivell [civil] att the present: ouer dere [our dear] friend James Fletcher

went for Irland [Ireland] this last winter and I recd [received] a letter from him

yesterday and he sayeth Wm Edmondson [William Edmondson] is gone ^to^ the West [Ingagues?] [West Antigues/Antigua?] before

he came thither: and Jon Burnet [John Burnett] is att home whos wife hath born him a son

but it is dead: and he sd [said] freinds are generly well meettings quit [quiet]..."


Based off the responses I found that researchers had a difficult time with unitization, which is an issue mentioned in Inter Annotator Agreement literature. Researchers had questions on how to break apart information in a sentence that has multiple mentions. For example, the line about James Fletcher going to Ireland and sending a letter to George Shaw would be considered two different mention types (trip and virtual document). Later in the week, Brook and I had a meeting discussing the process we had been making through quality assurance assessment. We both agreed that we would continue group mentions until the end of the summer then try to address unitization through other assessments/workshops. All in all, the researchers have expressed how these assessments have helped them understand mentions better which I was grateful to hear!


I also received news this week that my paper proposal, "Strengthening Quality Assurance in Digital Humanities Projects: Using Inter Annotator Agreement for Improved Protocols and Reliability," had been accepted to the Digitorium conference at the University of Alabama. 



As I finish my last couple of weeks of my internship I intend to focus on my internship showcase presentation and finishing my final paper.




Comments

Post a Comment

Popular posts from this blog

Week 1: Introduction

Hello! My name is Marissa Bellenger and I am a graduate student in the history department. This summer marks my second year in the program. My research interests are the Civil Rights Movement, Jim Crow, and the New Jim Crow. This summer I will be capstoning and defending my thesis proposal which is the NAACP Equalization campaign in Florida with a focus on the Florida State Teachers Association and professional member networks. This past year I have been a graduate research and teaching assistant for the history department. I also just finished an internship with the City of Orlando in the records department where I built my metadata, microfilm, and cataloging skills. In addition to working on the P.R.I.N.T project this summer I will be a research assistant for the Ah-Tah-Thi-Ki Seminole newspaper project.  I hope my internship with P.R.I.N.T. will improve my transcription skills as many sources in my own research are cursive handwriting that can be difficult to read. I also have a...
Post a Comment
Read more

Week 9: Group Mentions

Last week I had mid-term evaluations which were conducted by my project supervisor, Dr. Rosalind Beiler. Dr. Beiler and I discussed how the semester was going and I was asked if I would like to stay on--which I agreed to! I was given excellent marks on my evaluation. Last week I also develop an assessment for researchers to work on together. An important factor in Inter Annotator Agreement is the creation of an open, collaborative environment. A couple weeks ago researchers suggested that we all work on mentions as a group which I happily agreed to. They were presented with a short letter on screen and were instructed to fill out a Microsoft Form together with their answers. Here is the passage: 15866 - Roger Longworth, Rotterdam, Netherlands to James Harrison, n.p., [September] 24, 1679 "...and doe desire to Recaive a few Lines from you, diract them to Stephen Crisp at London or eles wheire I had thought to a write to yoou againe before I went from London, but I went out in hast,...
Post a Comment
Read more