tracked-cds

TRACKED-CDS Application

(c) 2025 AttND Lab, Purdue University

Pending

Finalize GO
Fix intermittent calib lockup
Fix postprocess exception

TODO

Calibration: Ensure all points successfully collected
Better mechanism for "centered" (non-fullscreen) videos?
Dynamic determination & intermingling of task run order
Drift check to recalibrate - pk: yes- do in real time & recalib. - calib: 1) redo drift check, ok? proceed w/trail 2) not ok: calib.
Subject's distance from screen - detect and record
Detect subject attention to screen, automatically recapture attention when needed
Error: meta file open in other app (usually Excel) - detect, report gracefully, address?
Fix bug: Selecting "Postprocess" with no recent session exits app (desired: dialog, back to menu)
Fix: Display calib, cats using center of emoji
Verify cleanups are run after sys.exit() or exceptions!
Data quality control: attention, sufficient data for biomarker (looking w/in regions of interest)
- metric: time spent in AOI's ("engagement")
- metric: usable capture over mult. trials in test
- how manu usuable trials from ea. task do have?
Logic: "dynamic switching"
- (pref, plr, baseline, gap overlap, cartoons)
- per-task engagement
- global engagement
- low engagement? go to cartoons
  - cartoons: engaged? repeat? new cartoon
- each task returns
  - sucess? enough data for biomarker calc
  - engagment - use validity flags
Build checks for trial success
Investigate "temporal filtering"?
Do we need to do a tracker time synch (using tobii_update_timesync, tobii_timesync)?
enter clinical info (scores), report at end
intervention, calib, run, exit
support ability for technician to test1, test2, test3 then report1, report2, report3

Completed TODOs

Calibration: Move on after collect
Drift as own module
Rightsize drift correction video (?)
Subject ID - prompt for and record
Infrastructue for AOI - create generic AOI object: rectangles only? In ui or px units?
Confirm how times are recorded and how they are represented is ok w/pk
Resolve normalized vs pixel coordinates for reporting gaze
Separate files per task or one huge file?
Replace video queue with task's get_next_video()
Verify pref AOI with plot
pref biomarker test: simple
Repo for production app
Utility for screen setup
Improve pref postproc accuracy
Integrate pref into app as template for tasks
Add main menu

Notes

"trial" - "blocks": multiple trials - "task":
jit, just-in-place training - future

Original menu:

1 = Baseline
2 = PLR
3 = GO
4 = Pref
5 = JA
c = Calibration
s = Videos w/ Sound
q = Exit

PREF (Experiment Builder)
- Prep: clear queues, load res., init triggers/actions, flush logs
- DRIFT_CORRECT
  - Play "BE_fix.avi" at 960,540 (x,y)
  - F4 key skips drift correct
- RECORDING_PREF_OG
  - Gaze recording: start
  - "Recording Pause Time": 20 (???)
  - DISPLAY_SCREEN_VPC
    - Fullscreen (1920x1080)
    - VPC_VIDEO_
      - _LEFT at 487,540 (x,y), size 868x480 (WxH), source: "_LEFT_VIDEO@" (variable)
      - _RIGHT at 1447,540 (x,y), size 864x480 (WxH), source: "_RIGHT_VIDEO@" (variable)
    - Interest_Areas
      - _LEFT at 480,540 (x,y), size 850x480 (WxH)
      - _RIGHT at 1440,540 (x,y), size 850x480 (WxH)
  - Esc key interrupts video playback and gaze recording
  - DISPLAY_SCREEN_VPC_BLANK
    - Clear Input Queues: (checked)
    - Show 1920x1080 (fullscreen) black image

Repository Rename: Local changes

cd track-cds
git remote set-url origin org-7122@github.itap.purdue.edu:AtteNDLab/tracked-cds.git
Rename directory
1. cd ..
2. ren track-cds tracked-cds
Rebuild venv:
1. rmdir /s /q .venv
2. uv venv .venv --python 3.10
3. .venv\Scripts\activate
4. uv pip install -r requirements.txt

Build Testing Laptop

Install UV (PowerShell): powershell -ExecutionPolicy ByPass -c "irm https://astral.sh/uv/install.ps1 | iex"
Install Python (cmd?): uv python install 3.10
Install Git (PowerShell): winget install --id Git.Git -e --source winget
Clone repo (cmd): 'git clone https://github.itap.purdue.edu/AtteNDLab/tracked-cds.git'
Set repo as shared access for all users (cmd)
- icacls "C:\tracked-cds" /grant Users:(OI)(CI)M /T
- icacls "C:\tracked-cds" /inheritance:e /grant:r Users:(OI)(CI)M /T
- git config core.sharedRepository world
Create venv (cmd)
- C:\tracked-cds>uv venv .venv --python 3.10
- .venv\Scripts\activate
- uv pip install -r requirements.txt
Get non-version-controlled required files
- tobii_python.pyd
- libwinpthread-1.dll
- tobii_stream_engine.dll
- se_license_key_purdue_temporary_professional_20260410.bytes

Additional Required Files

Save license key file named se_license_key_purdue_temporary_professional_20260410.bytes
These DLLs are required to use the tobii_python DLL (found via "objdump.exe -p tobii_python.pyd | findstr /C:"DLL Name"):
1. Place in same dir. as Python script:
  - libwinpthread-1.dll - from MinGW's bin
  - tobii_stream_engine.dll - from Tobii Streams SDK
2. Provided by Python and Windows
  - python310.dll
  - KERNEL32.dll
  - msvcrt.dll
See requirements.txt (created via uv pip freeze > requirements.txt) for Python packages

Environment

The "uv" package manager is used in the steps below.
You might be able to use other packages managers to do this.

Install Python 3.10, create a virtual environment, and install packages:

uv python install 3.10
uv venv .venv --python 3.10
.venv\Scripts\activate
uv pip install -r requirements.txt

test updates 1

AtteNDLab/tracked-cds

About

Resources

Uh oh!

Stars

Watchers

Forks

Releases

Languages