CSCE Capstone

Student Site for Individual and Collaborative Activities

CSCE Capstone

Student Site for Individual and Collaborative Activites

Let's Rethink the Online Classroom.

COVID-19 has altered the way we interact with large groups, forcing us to turn to a digital environment. The academic world has been hit hard, forcing college students to learn via Teams, or other video sharing platforms. In the virtual environment, information is still transferred from teacher to student, however the non-verbal cues of the students to the professor are lost. Professors have a harder time of “reading the room” as virtually every student has their camera and microphone turned off.

By creating an emotional and gesture tracking system, we can restore a small piece of human interaction by emulating how a real classroom would function. Creating a Chrome extension that can read in a student’s emotion or capture certain gestures in real time and relay that back to the teacher can provide a small sense of normalcy. Teachers can easily see who is interested, confused, or have left the class as naturally as they could if they were face-to-face. This will remove the awkward silences when a question is asked and can also help teachers learn how engaging they truly are in lecture.

Our Team.

Allison Frye

B.S.C.S Class of Spring 2021

Caleb Duke

B.S.C.S Class of Spring 2021

Cassidy McManus

B.S.Cmp.E Class of Spring 2021

Ryan Rau

B.S.C.S Class of Spring 2021

Gage Robinson

B.S.Cmp.E Class of Spring 2021

Project Tasks (Completed tasks are marked with ✓)
Sprint 1 (11/7 - 1/11) - Preliminary Research ✓
  • Iron out DB structure
  • Determine best languages for backend
  • Explore AWS Rekognition capabilities & limitations
  • Explore other methods of training ML models for use in our app
  • Look into limitations of browser extension
Sprint 2 (1/11 - 1/25) - Initial Setup ✓
  • Get both our DB and base Backend set up on servers
  • Set up AWS environment, ensuring team members have access
Sprint 3 (1/26 - 2/9) - Merge Components Together ✓
  • Backend: Basic CRUD operations on DB, set up for connection to and from extension and AWS
  • AWS: Set up Rekognition models, get ready for it to accept data from backend
  • Browser Extension: Prepare for communication with backend, create background task for image handling, get access to user’s camera
Sprint 4 (2/10 - 2/24) - Merge Components Together ✓
  • Link up extension to send and receive info from backend
  • Link up backend to send and receive data from AWS
Sprint 5 (2/25 - 3/11) - Expand AI & Start Reporting Page ✓
  • Begin expanding upong ML models, adding more emotions/ gestures
  • Begin teacher reporting page
Sprint 6 (3/12 - 3/26) - Continue Expanding ML/ Reporting Page ✓
  • Further expand upon ML models and reporting page
  • Begin to look inot additional features
Sprint 7 (3/27 - 4/12) - Continue additional features ✓
  • Continue with additional features
  • General optimization & testing project wide
Sprint 8 (4/13 - 4/27) - Final Touches, Report, Optimization ✓
  • Clean the project up, final touches, final report, etc…
Future Work
  • Improve accuracy of data which would require more time and different types of people
  • Would like to analyze live video streaming, but expensive
  • Size/scalability (not really good with lots of people)
  • A full statistics page for a student to evaluate their reactions
Contributions
  • Caleb Duke
    • Did all UI/UX for all services
    • Assisted in developing the tiling system
    • Assisted in AWS Rekognition research
  • Allison Frye
    • Developed starter code for Springboot application
    • Developed chrome extension and pinned tab
  • Cassidy McManus
    • Developed multiple Springboot endpoints, specifically for classes, users, and rosters
  • Ryan Rau
    • Developed predective modeling for emotions
    • Assisted in AWS Rekognition research
    • Responsible for running all services on virtual machines
  • Gage Robinson
    • Developed multiple Springboot endpoints, specifically for lectures and emotions
Links to Final Project Information:
Links to Project Proposal Information:

Deliverables