Inproceedings,

Crawling and Preprocessing Mailing Lists At Scale for Dialog Analysis

, , , and .
Proceedings of the 58th Annual Meeting of the Association for Computational Linguistics, page 1151--1158. Online, Association for Computational Linguistics, (July 2020)
DOI: 10.18653/v1/2020.acl-main.108

Abstract

This paper introduces the Webis Gmane Email Corpus 2019, the largest publicly available and fully preprocessed email corpus to date. We crawled more than 153 million emails from 14,699 mailing lists and segmented them into semantically consistent components using a new neural segmentation model. With 96\% accuracy on 15 classes of email segments, our model achieves state-of-the-art performance while being more efficient to train than previous ones. All data, code, and trained models are made freely available alongside the paper.

Tags

Users

  • @scadsfct

Comments and Reviews