Emerging Researchers National (ERN) Conference

nsf-logo[1]

  • About
    • About AAAS
    • About the NSF
    • About the Conference
    • Partners/Supporters
    • Project Team
  • Conference
  • Abstracts
    • Abstract Submission Process
    • Presentation Schedules
    • Abstract Submission Guidelines
    • Presentation Guidelines
    • Undergraduate Abstract Locator (2020)
    • Graduate Abstract Locator (2020)
    • Faculty Abstract Locator (2020)
  • Travel Awards
  • Resources
    • App
    • Award Winners
    • Code of Conduct-AAAS Meetings
    • Code of Conduct-ERN Conference
    • Conference Agenda
    • Conference Materials
    • Conference Program Books
    • ERN Photo Galleries
    • Events | Opportunities
    • Exhibitor Info
    • HBCU-UP/CREST PI/PD Meeting
    • In the News
    • NSF Harassment Policy
    • Plenary Session Videos
    • Professional Development
    • Science Careers Handbook
    • Additional Resources
    • Archives
  • Engage
    • Webinars
    • Video Contest
    • Video Contest Winners
    • ERN 10-Year Anniversary Videos
    • Plenary Session Videos
  • Contact Us

Real-time Analytics on Apache Spark Based Cloud Computing System

Graduate #58
Discipline: Computer Sciences and Information Management
Subcategory: Computer Science & Information Systems

Waled Tayib - Tennessee State University


Recently, the cloud computing industry has seen tremendous growth due to the widespread use of cloud resources for the Internet of Things (IoT). The increased use of IoT means that more and more data will be generated from sensors, machines, software, etc. With the amount of data generated daily being in the terabytes, there will be a higher demand for real-time processing capabilities in the cloud. A study conducted by the National Science Foundation in 2015 shows that IoT is on track to connect 50 billion devices by 2020, and one trillion sensors soon after. This research project presents a cloud computing infrastructure that has been set up at Tennessee State University to process all this data coming from IoT in real-time. The processing infrastructure consists of an Apache Spark based cloud-computing platform to ensure fast response. First, the performance of the Spark cluster was examined after conducting various real-time jobs such as machine learning, searching, and event counting. After testing, performance of the system has shown to achieve a general response time of less than one second. Future research on this project will consist of optimizing the Spark cluster specifically for each type of real-time processing use-case.

Not Submitted

Funder Acknowledgement(s): This study was funded by the NSF Research Initiation Award awarded to Dr. Sachin Shetty, Assistant Professor, Electrical and Computer Engineering, Tennessee State University, Nashville, TN 37209.

Faculty Advisor: Sachin Shetty, sshetty@tnstate.edu

ERN Conference

The 2022 ERN Conference has been postponed.

Full Notice

What’s New

  • Congratulations to Zakiya Wilson-Kennedy on her 2021 AAAS Fellowship
  • Event Vaccination and Liability Policy
  • Webinars
  • Events|Opportunities
  • AAAS CEO Comments on Social Unrest, Racism, and Inequality
  • Maintaining Accessibility in Online Teaching During COVID-19
  • In the News
  • HBCU/CREST PI/PD Meeting

Conference Photos

ERN Conference Photo Galleries

Awards

ERN Conference Award Winners

Checking In

nsf-logo[1]

This material is based upon work supported by the National Science Foundation (NSF) under Grant No. DUE-1930047. Any opinions, findings, interpretations, conclusions or recommendations expressed in this material are those of its authors and do not represent the views of the AAAS Board of Directors, the Council of AAAS, AAAS’ membership or the National Science Foundation.

AAAS

1200 New York Ave, NW Washington,DC 20005
202-326-6400
Contact Us
About Us

The World's Largest General Scientific Society

Useful Links

  • Membership
  • Careers at AAAS
  • Privacy Policy
  • Terms of Use

Focus Areas

  • Science Education
  • Science Diplomacy
  • Public Engagement
  • Careers in STEM

 

  • Shaping Science Policy
  • Advocacy for Evidence
  • R&D Budget Analysis
  • Human Rights, Ethics & Law
© 2022 American Association for the Advancement of Science