Seems to make sense for maximum privacy. Put together a large enough model to answer health queries, have OCR and image recognition to read exams, give it web access to search for medication details and, of course, gather raw data from any devices you use to measure weight, heart rate, etc.
But that’s just in theory and we all know things are hard to put together. In practice, have you had any experience getting anything like this working locally?
Personally, I think we have too much data on our own health habits.
Like it’s cool that we can record that data if needed, but smart watches, rings, and things make us track too much info for a none medical professionals. Like I, and most people I know, barely understand what our blood pressure readings mean.
Its good to be mindful of your health, but genuinely, a food journal and a poop journal would be more useful for your more immediate health and asking an LLM to process that data into trends would be easier to do and more useful for you and your doctor.
You can even not have any data layer all together. The only thing missing from a local LLM is knowledge of current medications by name if you want to just say whatever prescription you’re following.