Export File Type and Format Summary
- Updated
After downloading exported data from MyDataHelps Designer, you will have a number of data files in either Comma-Separated Value (CSV) or JSON format. Each file contains data from a single project. This article summarizes the data files and how to use them.
Data exports may contain Protected Health Information (PHI), Personally Identifiable Information (PII), and/or other health-related sensitive information, and must be transferred/stored in accordance with your organization’s security policies in order to ensure participant privacy and data security.
Data Files
The following tables describe the data files, and indicate whether they are available in the JSON export, the CSV export, or both. You can select the export format in your project's data export settings.
Most files contain incremental data from activity such as surveys taken, tasks, collected device data, logs, and other events. However some contain complete datasets or static snapshots, particularly participant data, survey versioning, and external accounts, and will be noted as such below.
Participant Data
| File Name | JSON Available? | CSV Available? | Description |
|---|---|---|---|
| AllParticipants | ✓ | ✓ | Information about all participants who have joined the project, including both analog and enrolled participants. |
| ParticipantPlatforms | ✓ | ✓ |
Information about all platforms (e.g. iOS, Android) used by participants to access the study. |
| SegmentParticipantHistory | ✓ | ✓ |
Activity log of when participants enter or leave segments. |
| SegmentParticipants | ✓ | ✓ |
A snapshot of which segments participants are currently in. |
Survey Data
| File Name | JSON Available? | CSV Available? | Description |
|---|---|---|---|
| SurveyConsentSignatureResults | see description | ✓ |
Detailed results for consent review step responses. In the JSON export, this data is contained in the SurveyResults file. |
| SurveyDictionary | ✓ |
Schema of all configured surveys across all versions. |
|
| SurveyDefinitions | ✓ | ✓ |
Details of all versions of all surveys in the workspace. |
| SurveyQuestionResults | see description | ✓ |
Detailed results for question and form step responses from completed surveys. In the JSON export, this data is contained in the SurveyResults file. |
| SurveyResults | ✓ | ✓ |
Information about each completed survey. In the JSON export, this file includes step and question results, consent signatures, and task results. |
| SurveyStepResults | see description | ✓ |
Detailed results for every step the participant completed in a survey. In the JSON export, this data is contained in the SurveyResults file. |
| SurveyTasks | ✓ | ✓ |
Lists survey tasks delivered to participants and their completion status. |
Analytics Events Data
| File Name | JSON Available? | CSV Available? | Description |
|---|---|---|---|
| CustomEvents | ✓ | ✓ |
Custom-defined events performed by participants in a project. |
| EmailEvents | ✓ | ✓ | Event data representing all email notifications triggered from MyDataHelps. |
| NotificationSent | ✓ | ✓ |
Event data for all notifications sent from MyDataHelps. |
| ParticipantRegistered | ✓ | ✓ |
Event data relating to participants registering for MyDataHelps. |
| ParticipantUpdated | ✓ | ✓ | Event data relating to updating participant information such as through schedules or manually by a coordinator. |
| PushNotification | ✓ | ✓ | Event data representing all push notifications triggered from MyDataHelps. |
| SMSNotification | ✓ | ✓ |
Event data representing all SMS notifications triggered from MyDataHelps. |
| SurveyStepViewed | ✓ | ✓ |
Event data of all survey steps viewed by participants. |
Symptom Shark Data
| File Name | JSON Available? | CSV Available? | Description |
|---|---|---|---|
| SymptomSharkDailyOverallExperience | ✓ | ✓ | All overall wellbeing scores submitted by participants in Symptom Shark. |
| SymptomSharkSymptomLogs | ✓ | ✓ | Complete log of symptoms and their severity reported by participants in Symptom Shark. |
| SymptomSharkTreatmentLogs | ✓ | ✓ | Complete log of treatments reported by participants in Symptom Shark. |
All Symptom Shark exports contain all data for the project; they are not limited to the export period.
Active Task Data
| File Name | JSON Available? | CSV Available? | Description |
|---|---|---|---|
| HolePegTest | see note below | ✓ | Detailed results from Hole Peg Test active tasks. |
| NormalizedReactionTime | see note below | ✓ | Detailed results from Normalized Reaction Time active tasks. |
| PacedSerialAdditionTest | see note below | ✓ | Detailed results from Paced Serial Addition Test (PSAT) active tasks. |
| RangeOfMotion | see note below | ✓ | Detailed results from Range of Motion active tasks. |
| SpatialSpanMemory | see note below | ✓ | Detailed results from Spatial Span Memory active tasks. |
| Stroop | see note below | ✓ |
Detailed results from Stroop active tasks. |
| TappingInterval | see note below | ✓ |
Detailed results from Tapping Interval active tasks. |
| TimedWalk | see note below | ✓ |
Detailed results from Timed Walk active tasks. |
| ToneAudiometry | see note below | ✓ |
Detailed results from Tone Audiometry active tasks. |
| TowerOfHanoi | see note below | ✓ |
Detailed results from Tower of Hanoi active tasks. |
| Trailmaking | see note below | ✓ |
Detailed results from Trailmaking active tasks. |
When your project uses the CSV export format for Survey Results, data for Active Tasks is exported in separate data files, organized by task type. When your project uses the JSON export format, Active Task data is included in the SurveyResults file.
Apple Device/Wearable Data
| File Name | JSON Available? | CSV Available? | Description |
|---|---|---|---|
| AppleLocationVisits | ✓ | ✓ |
Locations that participants have visited. |
| HealthKitV2ActivitySummaries | ✓ | ✓ |
Activity summary data from Apple HealthKit data captured by the Apple Watch. |
| HealthKitV2Characteristics | ✓ | ✓ |
Participant characteristics from Apple HealthKit data that do not typically change over time, like date of birth. |
| HealthKitV2ClinicalRecords | ✓ | ✓ |
Participant clinical data from Apple HealthKit, if they have linked Apple Health to their provider's Electronic Medical Record (EMR) system. |
| HealthKitV2Electrocardiograms | ✓ | ✓ |
Electrocardiogram (ECG) data from Apple HealthKit data captured by the Apple Watch. |
| HealthKitV2Heartbeats | ✓ | ✓ |
Heartbeat readings from Apple HealthKit data captured by the Apple Watch. |
| HealthKitV2Samples | ✓ | ✓ |
Simple quantity or category samples from Apple HealthKit data, like Heart Rate or Sleep Analysis. |
| HealthKitV2Statistics | ✓ | ✓ |
Daily data summary for specific elements such as daily steps from Apple Healthkit. |
| HealthKitV2Workouts | ✓ | ✓ |
Participant workout data from Apple HealthKit, if they track their workouts using an app or device. In the JSON export, this includes detailed event data. |
| HealthKitV2WorkoutEvents | see description | ✓ |
Detailed breakdown of participant workout data. In the JSON export, this data is contained in the HealthKitWorkouts file. |
| SensorKit | ✓ |
SensorKit data generated by a participants iPhone and paired AppleWatch. |
Fitbit Device/Wearable Data
| File Name | JSON Available? | CSV Available? | Description |
|---|---|---|---|
| FitbitActivityLogs | ✓ | ✓ | Log of participant activity details. |
| FitbitBodyWeightLogs | ✓ | ✓ | Log of participant-entered body weight data. |
| FitbitDailyData | ✓ | ✓ | Daily summary of a variety of activity and heart rate data. |
| FitbitDevices | ✓ | ✓ | All devices used by participants. |
| FitbitECGData | ✓ | ✓ |
Electrocardiogram (ECG) data collected by Fitbit devices. In the JSON export format, this includes the waveform data. |
| FitbitECGWaveforms | see description | ✓ |
Details of Fitbit Electrocardiogram (ECG) waveform data. In the JSON export, this data is contained in the FitbitECGData. |
| FitbitIntraday | ✓ | Raw data files returned by the Fitbit Intraday endpoint. | |
| FitbitIntradayCombined | ✓ | ✓ | Detailed data returned by the Fitbit Intraday endpoint. |
| FitbitProfiles | ✓ | ✓ | User profile and preferences for all participants. |
| FitbitRestingHeartRates | ✓ | ✓ | Daily participant resting heart rates. |
| FitbitSleepLogs | ✓ | ✓ |
Daily summary of participant sleep patterns. In the JSON export, this includes log detail data. |
| FitbitSleepLogDetails | see description | ✓ |
Detailed breakdown of participant sleep patterns. In the JSON export, this data is contained in the FitbitSleepLogs file. |
Garmin Device/Wearable Data
| File Name | JSON Available? | CSV Available? | Description |
|---|---|---|---|
| GarminActivitySummary | ✓ | ✓ | Summary data from discrete fitness activities. |
| GarminActivityDetailsSummary | ✓ | ✓ |
Detailed information about discrete fitness activities. In the JSON export, this includes laps and detailed sample data. |
| GarminActivityDetailsSummaryLaps | see description | ✓ | In the JSON export, this data is contained in the GarminActivityDetailsSummary. |
| GarminActivityDetailsSummarySamples | see description | ✓ | In the JSON export, this data is contained in the GarminActivityDetailsSummary. |
| GarminBloodPressureSummary | ✓ | ✓ | Data from blood pressure readings using a connected device or manually uploaded. |
| GarminBodyCompositionSummary | ✓ | ✓ | Biometric data such as weight or BMI. |
| GarminDailySummary | ✓ | ✓ |
Daily high-level summary data, such as steps and heart rate. In the JSON export, this includes detailed sample data. |
| GarminDailySummarySamples | see description | ✓ |
Heart rate samples throughout the day. In the JSON export, this is included in the GarminDailySummary file. |
| GarminEpochSummary | ✓ | ✓ | High-level summary data like steps and heart rate, in 15-minute intervals. |
| GarminHealthSnapshotSummary | ✓ | ✓ |
Data collected during a Health Snapshot on a compatible device. In the JSON export, this contains detailed sample data. |
| GarminHealthSnapshotSummarySamples | see description | ✓ |
Detailed sample data collected during a Health Snapshot on a compatible device. In the JSON export, this data is contained in the GarminHealthSnapshotSummary file. |
| GarminHeartRateVariabilitySummary | ✓ | ✓ |
Heart Rate Variability (HRV) collected during the overnight sleep window. In the JSON export, this includes detailed sample data. |
| GarminHeartRateVariabilitySummarySamples | see description | ✓ |
Details of Heart Rate Variability (HRV) samples. In the JSON export, this data is contained in the GarminHeartRateVariabilitySummary. |
| ✓ | ✓ | Activity data manually entered by the user, not uploaded from a Garmin device. | |
| GarminMoveIQActivitySummary | ✓ | ✓ | Activity data like running or biking automatically detected by a Garmin device, not initiated by the user. |
| GarminPulseOxSummary | ✓ | ✓ |
Daily blood oxygen saturation data. In the JSON export, this contains detailed sample data. |
| GarminPulseOxSummarySamples | see description | ✓ |
Detailed blood oxygen saturation sample data. In the JSON export, this data is contained in the GarminPulseOxSummary. |
| GarminRespirationSummary | ✓ | ✓ |
Daily respiration data collected by compatible devices. In the JSON export, this contains GarminRespirationSummarySamples data. |
| GarminRespirationSummarySamples | see description | ✓ |
Detailed respiration sample data collected by compatible devices. In the JSON export, this data is contained in the GarminRespirationSummary. |
| GarminSleepSummary | ✓ | ✓ |
Daily Summary of sleep data such as levels and duration. In the JSON export, this contains duration, samples, scores, and naps data. |
| GarminSleepSummaryDuration | see description | ✓ |
Details of sleep levels and duration at each level. In the JSON export, this is contained in the GarminSleepSummary. |
| GarminSleepSummarySamples | see description | ✓ |
Respiration data collected during sleep. In the JSON export, this is contained in the GarminSleepSummary. |
| GarminSleepScores | see description | ✓ |
Detailed breakdown of scores for different sleep levels and aspects. In the JSON export, this is contained in the GarminSleepSummary. |
| GarminSleepSummaryNaps | see description | ✓ |
Details of naps recorded by the device. In the JSON export, this is contained in the GarminSleepSummary. |
| GarminStressDetailSummary | ✓ | ✓ |
Daily summary of stress level data. In the JSON export, this contains samples and body battery events data. |
| GarminStressDetailSummarySamples | see description | ✓ |
Detailed samples of stress value data. In the JSON export, this is contained in the GarminStressDetailSummary. |
| GarminBodyBatteryActivityEvents | see description | ✓ |
Discrete events which affect users' Body Battery levels. In the JSON export, this is contained in the GarminStressDetailSummary. |
| GarminUserMetricsSummary | ✓ | ✓ | Calculated user metrics such as VO2Max and Fitness Age. |
Google Fit Device/Wearable Data
| File Name | JSON Available? | CSV Available? | Description |
|---|---|---|---|
| Google Fit | ✓ | ✓ | Health and activity data. |
External Accounts Data Exports
| File Name | JSON Available? | CSV Available? | Description |
|---|---|---|---|
| ElectronicHealthRecords | ✓ | see description | Complete Electronic Health Records (EHR) data from participants' health care providers, in FHIR format. An accompanying CSV maps participants to FHIR providers and records. |
| ExternalAccountsData | ✓ | ✓ | All external accounts linked to participants and their current status. |
Geographic Data
| File Name | JSON Available? | CSV Available? | Description |
|---|---|---|---|
| AirQualityIndexData | ✓ | ✓ | Daily air quality index. |
| WeatherData | ✓ | ✓ | Daily weather forecast. |
Additional Data
| File Name | JSON Available? | CSV Available? | Description |
|---|---|---|---|
| AuxiliaryData | ✓ | ✓ |
Auxiliary data files uploaded to individual participants. |
| ProjectDeviceData | ✓ | ✓ | Device data from any non-standard devices. |
| UploadedFiles | ✓ | ✓ | Files uploaded by participants, via surveys or SDK. |
CSV Column Names
As new fields are added to MyDataHelps Designer or to the sensor data services, those fields may be added to the data export files as well. Always use the column headers (the first line of each CSV file) to identify which fields appear in each column. The column header names will remain the same even if the column order changes or new columns are added.
JSON Formatting
Exports selected as JSON will be formatted in Newline Delimited JSON (NDJSON) format, unless otherwise noted. NDJSON consists of an array of JSON objects, one per line.
Associating Data Between Files
Whether you're using JSON or CSV exports, your project data will be spread out across multiple files. Identifiers aid you in cross-referencing data between these files.
Cross-Referencing Participant Data
The participants file lists all participants. In addition to their names, birthdates, etc., the participant is given a unique Participant Identifier. You'll find this same Participant Identifier referenced in other data files - survey results, sensor data, etc.
For example, consider this sample participant data. Chris Smith has Participant Identifier 81a5ca06-6bdb-423e-9ed7-49d81aa4be2a:
ParticipantIdentifier,GlobalKey,EmailAddress,FirstName,MiddleName,LastName,Gender,DateOfBirth,SecondaryIdentifier,EnrollmentDate,EventDates
81a5ca06-6bdb-423e-9ed7-49d81aa4be2a,5be1902c-e9d9-e711-815b-b9576bf93116,chris@example.com,Chris,,Smith,,1987-08-14,,2017-12-05T18:25:59Z,{}
When we look at the survey results data, we'll see that this result entry is also from participant 81a5ca06-6bdb-423e-9ed7-49d81aa4be2a, so we know it's from Chris.
SurveyResultKey,SurveyKey,SurveyName,SurveyVersion,ParticipantIdentifier,SurveyTaskKey,Type,StartDate,EndDate,DevicePlatform,DeviceName,DeviceOSVersion,InsertedDate 73b25dbd-e9d9-e711-815b-b9576bf93116,dcbede15-67c9-e711-815a-a2abfc96a420,Consent,0,81a5ca06-6bdb-423e-9ed7-49d81aa4be2a,,Consent,2017-12-05T13:25:47-05:00,2017-12-05T13:25:58-05:00,iOS,"iPhone7,1",10.0,2017-12-05T18:25:59Z
We can also find Chris in the survey tasks data, to see which survey tasks he's been assigned and whether they're completed. This will help you measure survey adherence.
SurveyTaskKey,ParticipantIdentifier,SurveyKey,SurveyName,Status,DueDate,InsertedDate,CreatedBy,ModifiedDate
9bb25dbd-e9d9-e711-815b-b9576bf93116,81a5ca06-6bdb-423e-9ed7-49d81aa4be2a,059966f9-e3a7-e711-8159-cb0f82935acb,Medical History: Cardiovascular Diagnoses,Incomplete,2017-12-19T18:26:00Z,2017-12-05T18:26:00Z,MyDataHelps Designer Survey Scheduler,2017-12-05T18:26:00Z
Cross-Referencing Survey Data
Survey results are also linked together with cross-reference keys. The following table shows how you can associate data from different survey result files.
| Survey | SurveyResult | SurveyStepResult | SurveyQuestionResult | |||
|---|---|---|---|---|---|---|
| SurveyKey | ⇄ | SurveyKey | ||||
| SurveyResultKey | ⇄ | SurveyResultKey | ||||
| SurveyStepResultKey | ⇄ | SurveyStepResultKey | ||||
| SurveyQuestionResultKey |
[Legacy] Data Files
The following data files may exist for ongoing and completed projects, but are not available for new projects.
[Legacy] Participant Data
| File Name | Description |
|---|---|
| EnrolledParticipants | Information about participants who have enrolled in the project via MyDataHelps. |
[Legacy] Analytics Events Data
| File Name | Description |
|---|---|
| EmailNotificationSent | Information about email notifications sent to participants. |
| NotificationsData | Information about notifications delivered to participants. |
| SMSNotificationSent | Information about SMS notifications sent to participants. |
[Legacy] Apple Healthkit
| File Name | Description |
|---|---|
| HealthKitCharacteristics | Participant characteristics from Apple HealthKit data that do not typically change over time, like date of birth. |
| HealthKitSamples | Simple quantity or category samples from Apple HealthKit data, like Heart Rate or Sleep Analysis. |
| HealthKitActivitySummaries |
Activity summary data from Apple HealthKit data captured by the Apple Watch. |
| HealthKitWorkouts |
Participant workout data from Apple HealthKit, if they track their workouts using an app or device. |
| HealthKitWorkoutEvents |
Detailed breakdown of participant workout data. In the JSON export, this data is contained in the HealthKitWorkouts file. |
| HealthKitClinicalData | Participant clinical data from Apple HealthKit, if they have linked Apple Health to their provider's Electronic Medical Record (EMR) system. |
Was this article helpful?