项目作者: lizhouf

项目描述 :
COVID-19 Hate Speech Twitter Archive (CHSTA)
高级语言:
项目地址: git://github.com/lizhouf/CHSTA.git
创建时间: 2020-09-02T04:49:19Z
项目社区:https://github.com/lizhouf/CHSTA

开源协议:

下载


CHSTA

COVID-19 Hate Speech Twitter Archive (CHSTA)

Repository for Lizhou Fan, Huizi Yu and Zhanyuan Yin for the analysis of Hate Speech for COVID-19 on Twitter. “Stigmatization in Social Media: Documenting and Analyzing Hate Speech for COVID-19 on Twitter” ASIST 2020. [Paper Link]

Data Collection

During the critical period between coronavirus’s emergence and ensuing outbreak (January 31, 2020 to April 7, 2020), we’ve conducted six waves of data collection, each lasting approximately one week. We have queried the Twitter API using the keyword “coronavirus+and+china” and collected 3,482,197 unique tweets across six waves. In accordance with Twitter’s Terms of Service, we only publically release the tweet ID and the date on which the tweet is created.

How to Hydrate

Please refer to the DocNow Hydrator Github repository for instructions on how to obtain the complete information corresponding to each Tweet ID.

Data Usage Agreement

Statistics Summary

Number of Tweets : 3,482,197

Language breakdown of top 10 most prevalent languages :
| Wave | Start Date | End Date | Total Number of Tweets|
|——————-|————————|————————|———————————-|
| 1 |2020-01-31 |2020-02-07 |445,893 |
| 2 |2020-02-07 |2020-02-17 |297,654 |
| 3 |2020-03-03 |2020-03-12 |422,146 |
| 4 |2020-03-15 |2020-03-22 |1,031,969 |
| 5 |2020-03-22 |2020-03-29 |673,625 |
| 6 |2020-03-31 |2020-04-07 |610,910 |

* Wave 4 data is split into 4A and 4B due to the complete data file exceeding the maximum data size on Github.

Contact

Please contact Lizhou Fan at lizhou@ucla.edu if you have any question.

Acknowledgement

We thank UCLA Digital Research Consortium for their support in scraping and storing the data. We thank Dave Shepard and Ed Summers for thier inspiring suggestions and resources of the scraping processes.