Skip to content

FIX CSV data upload and remove demographic data storage #66

Description

@fstonedahl

Background:

Several times a year Jana Arpy from ITS needs to upload new CSV data mapping student ID #s to emails (for Pepsico).

e.g. on the old deployment at : https://osl-events-app.firebaseapp.com/upload/
or maybe the newer https://vike-web.vercel.app/upload , except that the Google login seems to be broken on the vercel domain one.

  1. Currently, it's uploading into the realtime DB within firebase at this tree location: /id-to-email-test
    a) But it should be going directly into: /id-to-email
    b) Also, it should be REPLACING the contents of that whole tree, rather than always adding more users!
    c) (Furthermore, the performance of uploading each individual row is VERY bad -- instead, we should create a Javascript object that represents the whole subtree (containing all of the id:email pairs, and then use set() to replace the whole /id-to-email subtree in one single firebase operation!)

  2. The original plan was to include a bunch of demographic data about students as well, so that OSL could use that to generate reports about how many first year students, women, international students, etc, were attending different events.

However, there are too many privacy concerns about that data, so we should just purge all of the demographic data from our database, and ALSO change the upload code to avoid inserting any demographic data (from the CSV file) into it in the first place! We only want to upload the id->email pairs.

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type

    Fields

    No fields configured for issues without a type.

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions