Connect with us

Technology

The humble screenshot might be the key to great AI assistants

Published

on

The humble screenshot might be the key to great AI assistants

If you want to make the most out of a world increasingly filled with AI tools, here’s a habit to develop: start taking screenshots. Lots of screenshots. Of anything and everything. Because for all the talk of voice modes, omnipresent cameras, and the multimodal future of everything, there might be no more valuable digital behavior than to press the buttons and save what you’re looking at.

Screenshots are the most universal method of capturing digital information. You can capture anything — well, almost anything, thanks a lot, Netflix! — with a few clicks, and save and share it to almost any device, app, or person. “It’s this portable data format,” says Johnny Bree, the founder of the digital storage app Fabric. “There’s nothing else that’s quite so portable that you can move between any piece of software.”

A screenshot contains a lot of information, like its source, contents, and even the time of the day in the corner of the screen. Most of all, it sends a crucial and complex signal; it says I care about this. We have countless new AI tools that aim to watch the world, our lives, and everything, and try to make sense of it all for us. These tools are mostly crap for lots of reasons but mostly because AI is pretty good at knowing what things are, but it’s rubbish at knowing whether they matter. A screenshot assigns value and tells the system it needs to pay attention.

Screenshots also put you, the user, in control in an important way. “If I give you access to all of my emails, all my WhatsApps, everything, there’s a lot of noise,” says Mattias Deserti, the head of smartphone marketing at Nothing. There’s simply no reason to save every email you receive or every webpage you visit — and that’s to say nothing of the privacy implications. “So what if, instead, you were able to start training the system yourself, feeding the system the information you want the system to know about you?” Rather than a tool like Microsoft Recall, which asks for unlimited access to everything, starting with screenshots lets you pick what you share.

Until now, screenshots have been a fairly blunt instrument. You snap one, and it gets saved to your camera roll, where it probably languishes, forgotten, until the end of time. (And don’t get me started on all the screenshots I take by accident, mostly of my lockscreen.) At best, you might be able to search for some text inside the image. But it’s more likely that you’ll just have to s scroll until you find it again.

Advertisement

The first step in making screenshots more useful is to figure out what’s actually in them

The first step in making screenshots more useful is to figure out what’s actually in them. This is, at first blush, not terribly complicated: optical character recognition technology has long done a good job of spotting text on a page. AI models take that one step further, so you can either search the title or just “movies” to find all your digital snaps of posters, Fandango results, TikTok recommendations, and more. “We use an OCR model,” says Shenaz Zack, a product manager at Google and part of the team behind the Pixel Screenshots app. “Then we use an entity-detection model, and then Gemini to understand the actual context of the screen.”

See, there’s far more to a screenshot than just the text inside. The right AI model should be able to tell that it came from WhatsApp, just by the specific green color. It should be able to identify a website by its header logo or understand when you’re saving a Spotify song name, a Yelp handyman review, or an Amazon listing. Armed with this information, a screenshot app might begin to automatically organize all those images for you. And even that is just the beginning.

With everything I’ve described so far, all we’ve really created is a very good app for looking at your screenshots, which no one really thinks is a good idea because it would be just one more thing to check — or forget to check. Where it gets vastly more interesting is when your device or app can actually start to use the screenshots on your behalf, to help you actually remember what you captured or even use that information to get stuff done.

In Nothing’s new Essential Space app, for instance, the app can generate reminders based on stuff you save. If you take a screenshot of a concert you’d like to go to, it can remind you that it’s coming up automatically. Pixel Screenshots is pushing the idea even further: if you save a concert listing, your Pixel phone can prompt you to listen to that band the next time you open Spotify. If you screenshot an ID card or a boarding pass, it might ask you to put it in the Wallet app. The idea, Zack says, is to think of screenshots as an input system for everything else.

Advertisement

It’s one thing to screenshot a band you like. It’s another to be able to find them again later.
Image: David Pierce / The Verge

Mike Choi, an indie developer, built an app called Camp in part to help him make use of his own screenshots. He began to work on turning every screenshot into a “card,” with the salient information stored alongside the picture. “You have a screenshot, and at the bottom there’s a button, and it flips the card over,” he says. “It shows you a map, if it was a location; a preview of a song, if it’s a song. The idea was, given an infinite pool of different types of screenshots, can AI just generate the perfect UI for that category on the fly?”

If all this sounds familiar, it’s because there’s another term for what’s going on here: it’s called agentic AI. Every company in tech seems to be working on ways to use AI to accomplish things on your behalf. It’s just that, in this case, you don’t have to write long prompts or chat back and forth with an assistant. You just take a screenshot and let the system go to work. “You’re building a knowledge base, when today that knowledge base is confined to your gallery and nothing happens with it,” Deserti says. He’s excited to get to the point where you screenshot a concert date, and Essential Space automatically prompts you to buy tickets when they go on sale.

Making sense of screenshots isn’t always so straightforward

Making sense of screenshots isn’t always so straightforward, though. Some you want to keep forever, like the ID card you might need often; other things, like a concert poster or a parking pass, have extremely limited shelf lives. For that matter, how is an app supposed to distinguish between the parking pass you use every day at work and the one you used once at the airport and never need again? Some of the screenshots on my phone were sent to me on WhatsApp; others I grabbed from Instagram memes to send to friends. No one’s camera roll should ever be fully held against them, and the same goes for screenshots. Lots of these screenshot apps are looking for ways to prompt you to add a note, or organize things yourself, in order to provide some additional helpful information to the system. But it’s hard work to do that without ruining what makes screenshots so seamless and easy in the first place.

Advertisement

One way to begin to solve this problem, to make screenshots even more automatically useful, is to collect some additional context from your device. This is where companies like Google and Nothing have an advantage: because they make the device, they can see everything that’s happening when you take a screenshot. If you grab a screenshot from your web browser, they can also store the link you were looking at. They can also see your physical location or note the time and the weather. Sometimes this is all useful, but sometimes it’s nonsense; the more data they collect, the more these apps risk running into the same noise problem that screenshots helped solve in the first place.

But the input system works. We all take screenshots, all the time, and we’re used to taking them as a way to put a marker on so many kinds of useful information. Getting access to that kind of relevant, personalized data is the hardest thing about building a great AI assistant. The future of computing is certainly multimodal, including cameras, microphones, and sensors of all kinds. But the first best way to use AI might be one screenshot at a time.

Technology

Honda’s hybrid future starts with new Accord and RDX prototypes

Published

on

Honda’s hybrid future starts with new Accord and RDX prototypes

Honda revealed prototypes of two new hybrid models, an Accord sedan and the Acura RDX SUV, during its annual business briefing this week, built on a platform that it says will begin launching next year. The RDX was announced earlier this year as Honda’s first SUV to feature the next-gen version of its two-motor hybrid system.

In March, Honda announced it would take a writedown of up to 2.5 trillion yen ($15.7 billion) on its EV investments. Now Honda says its EV-related losses will be “resolved” by 2029, and that it will reevaluate its EV plans in 2030.

Continue Reading

Technology

New cancer tech sends chemo straight to tumors

Published

on

New cancer tech sends chemo straight to tumors

NEWYou can now listen to Fox News articles!

Chemotherapy can save lives, but anyone who has watched a loved one go through it knows how hard it can be. The nausea. The exhaustion. The infections. The days when even getting off the couch feels like too much.

That happens because standard chemotherapy travels through the bloodstream. It attacks cancer cells but can also harm healthy cells along the way. For some pancreatic cancer patients, that approach may be changing.

A targeted drug-delivery system from RenovoRx is designed to send chemotherapy directly near the tumor instead of through the entire body. The system, called Trans-Arterial Micro-Perfusion, or TAMP, is being studied in a Phase III clinical trial for locally advanced pancreatic cancer.

For 83-year-old Hernando Salcedo, who had been left weak, nauseous and overwhelmed by standard chemotherapy, the trial offered something he desperately needed: a reason to hope. He enrolled at Miami Cancer Institute and soon began to feel the shift in his own body. His appetite started coming back. His energy improved. He felt more like himself. “The difference was tremendous,” Hernando said. “I completed eight sessions, one every 15 days, and I felt dramatically better than I did with the original chemotherapy.”

Advertisement

HIDDEN FACTOR IN CANCER TREATMENT TIMING MAY AFFECT SURVIVAL, RESEARCHERS SAY

Cancer patient Hernando Salcedo attended a family wedding after RenovoRx’s Trans-Arterial Micro-Perfusion system delivered chemotherapy directly near his tumor, helping him feel stronger during treatment. (Hernando Salcedo)

 Sign up for my FREE CyberGuy Report

  • Get my best tech tips, urgent security alerts and exclusive deals delivered straight to your inbox.
  • For simple, real-world ways to spot scams early and stay protected, visit CyberGuy.com trusted by millions who watch CyberGuy on TV daily.
  • Plus, you’ll get instant access to my Ultimate Scam Survival Guide free when you join.

 

How the RenovoRx drug-delivery device works

RenovoRx’s platform uses the FDA-cleared RenovoCath device to deliver chemotherapy through a catheter placed in an artery near the tumor. A physician guides the catheter into position using X-ray imaging.

Shaun Bagai, CEO of RenovoRx, said the platform is designed to localize chemotherapy delivery near the tumor instead of relying on the drug to travel through the whole body.

“Once in position, two small balloons on the catheter are inflated, and the system is adjusted to isolate a targeted segment of artery adjacent to a tumor,” Bagai said. “The chemotherapy drug is then infused between the balloons, creating pressure to push the drug across the vessel wall and near the tumor, directly bathing the target tumor.”

Advertisement

That setup allows doctors to focus treatment in a specific area rather than exposing more of the body to chemotherapy. “The procedure itself is minimally invasive and is typically performed in an outpatient setting without the need for patients to be put under general anesthesia,” Bagai said.

For patients already dealing with pain, fatigue and fear, that outpatient approach may feel less overwhelming than a major hospital procedure.

 

How targeted chemotherapy for pancreatic cancer works

To understand why this approach matters, it helps to start with the problem doctors are trying to solve. Dr. Ripal Gandhi, a vascular interventional radiologist and interventional oncologist at Baptist Health Miami Cardiac & Vascular Institute and Miami Cancer Institute, explained why standard chemotherapy can be so hard on the body.

“With IV chemotherapy, the drug travels through the bloodstream, affecting both cancerous and healthy cells, which can lead to side effects,” Dr. Gandhi said. TAMP takes a more targeted route. A doctor places a catheter in an artery near the tumor, then delivers chemotherapy into that area instead of relying on the drug to circulate throughout the body.

Dr. Gandhi compared it to “a drip irrigation system for individual plants instead of watering an entire lawn.” For patients, that means doctors are trying to focus more of the treatment near the cancer while reducing how much chemotherapy reaches the rest of the body.

Advertisement

 

Why pancreatic cancer is so difficult to treat

Pancreatic cancer has a reputation for being one of the hardest cancers to fight, partly because the tumor itself can block treatment from working the way doctors want it to.

Dr. Gandhi said that creates a major challenge for standard IV chemotherapy. “Studies have shown that less than 10% of chemotherapy administered intravenously actually reaches tumor cells due to the few blood vessels in the tumor as well as dense fibrous stroma, which serves as a physical barrier in the tumor microenvironment,” Dr. Gandhi said.

That helps explain why targeted delivery could play an important role. TAMP sends the drug closer to the tumor rather than depending on the bloodstream to do all the work.

“This targeted approach via TAMP does not rely on chemotherapy circulating through the body to carry the drug to the tumor via tumor feeder vessels,” Dr. Gandhi said. “Trans-arterial micro-perfusion is a drug-delivery platform that delivers chemotherapy directly near the target tumor where it is needed most.”

NEW CANCER THERAPY HUNTS AND DESTROYS DEADLY TUMORS IN MAJOR BREAKTHROUGH STUDY 

Advertisement

Chase McCann, associate director of the cell therapy lab core, demonstrates how cancerous T-cells from a child are used to develop an autoimmune treatment to fight cancer at Children’s National Hospital in Washington, D.C., on Aug. 26, 2025. (Marvin Joseph/The Washington Post/Getty Images)

 

Patient says targeted chemotherapy gave him hope

Hernando’s cancer journey began after he went to the doctor with a swollen stomach and hip pain. Doctors diagnosed him with locally advanced pancreatic cancer. When he started standard chemotherapy in August 2025, the side effects hit hard. “My body was going through an incredible amount of stress,” Hernando said. “My stomach was inflamed, I had persistent pain in my head, and I had almost no energy.”

He was also receiving chemotherapy and radiation at the same time. “It was a very difficult period, both physically and emotionally,” he said. “I remember feeling exhausted, overwhelmed and unsure of what the future would look like.”

When doctors presented the targeted treatment option, Hernando saw it as more than another medical procedure. “To me, it felt like a new opportunity to live,” he said. “It gave me hope at a time when my family and I really needed it.”

He credits Dr. Gandhi and the team at Miami Cancer Institute with helping him through it all. “From the beginning, he was honest, supportive and clear with my wife, my family and me,” Hernando said. “That meant everything.” 

Advertisement

Fewer chemotherapy side effects changed daily life

“Before, I was losing weight, had no appetite and felt drained,” Hernando said. “After switching treatments, things began to change. I stopped losing weight, my appetite came back, my color improved and I had more energy.”

Cancer treatment can sometimes take over everyday life. When side effects ease, patients can get pieces of their normal life back. “After about eight weeks, we could see real progress,” Hernando said. “I was eating more, moving more and feeling excited about life again.”

One moment still stands out. Hernando was able to attend a family wedding and dance the entire night. “That moment meant everything to me,” he said. “After everything I had been through, being able to celebrate with my family in that way felt like a gift.” For Hernando, it was a chance to feel like himself again. “That night at the wedding, I was not thinking only about cancer or treatment,” Hernando said. “I was living.”

 

Early trial results show survival and quality-of-life signals

The early data from RenovoRx’s Phase III TIGeR-PaC trial suggest the targeted approach may offer both survival and tolerability benefits for some patients.

Dr. Gandhi said completed clinical studies with TAMP in pancreatic cancer showed “a potential for better outcomes and less side effects for patients.”

Advertisement

“In the initial interim analysis of the TIGeR-PaC clinical trial, there was a trend towards improved overall survival by 6 months and improvement in the progression free survival by 8.1 months with 65% fewer adverse events in the TAMP arm of the study,” Dr. Gandhi said.

 

Who may benefit from targeted chemotherapy delivery?

This approach isn’t for every pancreatic cancer patient. Doctors still need to look at the cancer stage, tumor location, treatment history and whether the cancer has spread.

Dr. Gandhi said Hernando was the kind of patient who could be a strong fit. “He is precisely the type of patient who would benefit best from this approach because he has a tumor which is too far advanced to be treated surgically, but it has not spread to other organs,” Dr. Gandhi said.

He also pointed to clinical trials as an important option for pancreatic cancer patients.”I discussed with him that the recommendation of the National Comprehensive Cancer Network is that the best management for pancreatic cancer patients is participation in a clinical trial whenever possible and he was an ideal candidate,” Dr. Gandhi said.

He went on to say that TAMP may be an option for patients who are not candidates for surgery, patients who have failed chemotherapy or patients who no longer want to continue IV chemotherapy because of side effects.

Advertisement

“TAMP can be used at any point within the treatment landscape, before, during or after other treatment modalities such as IV chemotherapy or radiation,” he said.

PANCREATIC CANCER PATIENT SURVIVAL DOUBLED WITH HIGH DOSE OF COMMON VITAMIN, STUDY FINDS

The RenovoCath device uses a catheter-based system to deliver chemotherapy near the tumor instead of through the whole body. (RenovoRx)

 

What comes next for RenovoRx’s cancer treatment platform

RenovoRx says the RenovoCath catheter is already FDA-cleared for general therapy and chemotherapy delivery. The company is also nearing the end of enrollment in its Phase III TIGeR-PaC trial.

That trial is evaluating intra-arterial gemcitabine (IAG) delivered through RenovoCath for locally advanced pancreatic cancer. Bagai said enrollment is expected to be completed in mid-2026, with final results expected in 2027.

Advertisement

“If positive, data generated from this trial could potentially support a new drug application for this combination product to the FDA for IAG,” Bagai said. RenovoRx also sees potential beyond pancreatic cancer. “The challenge we are addressing is not unique to pancreatic cancer,” Bagai said.

He said the platform could apply to other solid tumors with limited blood supply, including bile duct cancer, certain lung cancers and sarcomas. “The platform is designed to work with different types of therapies, not just one drug,” Bagai said. “That opens the door to future combinations and potential partnerships, with the goal of expanding options for patients who have limited treatment choices.” 

 

What this means to you

If you or someone you love has pancreatic cancer, this story is worth paying attention to. Clinical trials can open up options when standard treatment feels too hard to tolerate or stops working.

Drug delivery matters, too. The medicine itself is only part of the story. Where it goes inside the body can affect side effects, energy levels and quality of life. Targeted chemotherapy delivery remains a specialized treatment approach. Some cancer centers may not offer it, and every diagnosis will not be a fit. Your care team can review imaging, staging, prior treatments and overall health to see whether it makes sense.

Start with direct questions. Ask whether a clinical trial makes sense. You can also ask about targeted delivery options or a second opinion from a pancreatic cancer specialist. Hernando’s advice to other patients is simple. “I would tell them not to lose hope and not to wait to ask questions,” he said. 

Advertisement

Take my quiz: How safe is your online security?

Think your devices and data are truly protected? Take this quick quiz to see where your digital habits stand. From passwords to Wi-Fi settings, you’ll get a personalized breakdown of what you’re doing right and what needs improvement. Take my Quiz here: Cyberguy.com     

 

Kurt’s key takeaways

Pancreatic cancer has a way of turning normal life upside down fast. One day, a family is making plans. The next, they are trying to understand scans, treatment choices and side effects that no one feels ready for. That is what makes Hernando’s story so powerful. The part that stays with you isn’t only the technology. It is the fact that he started eating again. He had more energy. He felt more like himself. And he got to dance at a wedding after wondering what the future would look like. The final Phase III trial results will be important. Doctors still need to see how widely this approach could help patients. But the promise is easy to understand. If chemotherapy can get closer to the tumor while taking less of a toll on the rest of the body, patients may get something that matters just as much as treatment itself: more good days.

CLICK HERE TO DOWNLOAD THE FOX NEWS APP

If you or someone you loved needed chemo, would targeted delivery change how you think about treatment? Let us know by writing to us at Cyberguy.com

Advertisement

Sign up for my FREE CyberGuy Report

  • Get my best tech tips, urgent security alerts and exclusive deals delivered straight to your inbox.
  • For simple, real-world ways to spot scams early and stay protected, visit CyberGuy.com trusted by millions who watch CyberGuy on TV daily.
  • Plus, you’ll get instant access to my Ultimate Scam Survival Guide free when you join.

Copyright 2026 CyberGuy.com.  All rights reserved.

Continue Reading

Technology

Use this map to find the data centers in your backyard

Published

on

Use this map to find the data centers in your backyard

When Oregon resident Isabelle Reksopuro heard Google was gobbling up public land to fuel its data centers in her home state, she didn’t initially know what to believe. “There’s a lot of misinformation about data centers,” she said. “Google has denied taking that land.”

Technically, she explains, The Dalles, a city near the Washington state border, sought to reclaim that land, “and Google is just a big, unnamed power user.” The city had in fact asked for ownership of a 150-acre portion of Mount Hood National Forest, claiming it needs access to Mount Hood’s watershed to meet municipal needs as its population — 16,010 as of the 2020 census — grows. But critics, including environmentalists, say the city is trying to secure more water for Google, which has a sprawling data center campus in The Dalles that already consumes about one-third of the city’s water supply.

This controversy made Reksopuro curious about the backlash to data centers being built in other communities. So Reksopuro, a student at the University of Washington who studies the connections between tech and public policy, decided to map it out. Using information collected by Epoch AI and data scraped from legislation on data centers, she built an interactive map tracking AI policy around the world. She designed it to be simple enough for anyone to use. “I wanted it to be something that my younger sisters could play through and explore to understand what are the data centers in the area and what’s actually being done about it,” Reksopuro said. She hoped to shift their opinions that way, “instead of like, through TikTok.”

Four times a day, the map searches for new sources and checks them against the existing database Reksopuro built out. “Once it does that, it will write a new summary, add it to the news feed, and populate it on the sidebar,” she said. “I wanted it to be self-updating, since I’m also a student.”

Reksopuro isn’t against data centers, but she thinks tech giants benefit from a lack of transparency around data center policies. “Right now, it’s this really opaque thing — and all of a sudden, there’s a facility,” she said. “I think that if people knew about data centers beforehand, it would give them leverage. They would be able to negotiate: ask for job training programs, tax revenue, environmental monitoring, things to improve their community.”

Advertisement
Continue Reading
Advertisement

Trending