Innovation

Rice Team Developing Flat Microscope for the Brain

DARPA project's aims include restoring sight and sound to disabled


0717_DARPA-2-web
By Mike Williams | July 13, 2017

Rice University engineers are building a flat microscope, called FlatScope TM, and developing software that can decode and trigger neurons on the surface of the brain. Their goal as part of a new government initiative is to provide an alternate path for sight and sound to be delivered directly to the brain.

The project is part of a $65 million effort announced this week by the federal Defense Advanced Research Projects Agency (DARPA) to develop a high-resolution neural interface. Among many long-term goals, the Neural Engineering System Design (NESD) program hopes to compensate for a person’s loss of vision or hearing by delivering digital information directly to parts of the brain that can process it.

Members of Rice’s Electrical and Computer Engineering Department will focus first on vision. They will receive $4 million over four years to develop an optical hardware and software interface. The optical interface will detect signals from modified neurons that generate light when they are active. The project is a collaboration with the Yale University-affiliated John B. Pierce Laboratory led by neuroscientist Vincent Pieribone.

Current probes that monitor and deliver signals to neurons — for instance, to treat Parkinson’s disease or epilepsy — are extremely limited, according to the Rice team. “State-of-the-art systems have only 16 electrodes, and that creates a real practical limit on how well we can capture and represent information from the brain,” Rice engineer Jacob Robinson said.

Robinson and Rice colleagues Richard Baraniuk, Ashok Veeraraghavan and Caleb Kemere are charged with developing a thin interface that can monitor and stimulate hundreds of thousands and perhaps millions of neurons in the cortex, the outermost layer of the brain.

“The inspiration comes from advances in semiconductor manufacturing,” Robinson said. “We’re able to create extremely dense processors with billions of elements on a chip for the phone in your pocket. So why not apply these advances to neural interfaces?”

Kemere said some teams participating in the multi-institution project are investigating devices with thousands of electrodes to address individual neurons. “We’re taking an all-optical approach where the microscope might be able to visualize a million neurons,” he said.

That requires neurons to be visible. Pieribone’s Pierce Lab is gathering expertise in bioluminescence — think fireflies and glowing jellyfish — with the goal of programming neurons with proteins that release a photon when triggered. “The idea of manipulating cells to create light when there’s an electrical impulse is not extremely far-fetched in the sense that we are already using fluorescence to measure electrical activity,” Robinson said.

The scope under development is a cousin to Rice’s FlatCam, developed by Baraniuk and Veeraraghavan to eliminate the need for bulky lenses in cameras. The new project would make FlatCam even flatter, small enough to sit between the skull and cortex without putting additional pressure on the brain, and with enough capacity to sense and deliver signals from perhaps millions of neurons to a computer.

Alongside the hardware, Rice is modifying FlatCam algorithms to handle data from the brain interface.

“The microscope we’re building captures three-dimensional images, so we’ll be able to see not only the surface but also to a certain depth below,” Veeraraghavan said. “At the moment we don’t know the limit, but we hope we can see 500 microns deep in tissue.”

“That should get us to the dense layers of cortex where we think most of the computations are actually happening, where the neurons connect to each other,” Kemere said.
A team at Columbia University is tackling another major challenge: The ability to wirelessly power and gather data from the interface.

In its announcement, DARPA described its goals for the implantable package. “Part of the fundamental research challenge will be developing a deep understanding of how the brain processes hearing, speech and vision simultaneously with individual neuron-level precision and at a scale sufficient to represent detailed imagery and sound,” according to the agency. “The selected teams will apply insights into those biological processes to the development of strategies for interpreting neuronal activity quickly and with minimal power and computational resources.”

“It’s amazing,” Kemere said. “Our team is working on three crazy challenges, and each one of them is pushing the boundaries. It’s really exciting. This particular DARPA project is fun because they didn’t just pick one science-fiction challenge: They decided to let it be DARPA-hard in multiple dimensions.”

Baraniuk is the Victor E. Cameron Professor of Electrical and Computer Engineering. Robinson, Veeraraghavan and Kemere are assistant professors of electrical and computer engineering.

Tags | Innovation



Social Posts

profile_image

Houston Methodist

@MethodistHosp

4.26, noon-3 p.m.: @MethodistHosp San Jacinto Hospital Hiring Event for experienced RNs. Learn more: https://t.co/4v7r2jpdTP https://t.co/pVFG8AmsG4

57 mins ago
profile_image

MD Anderson Cancer Center

@MDAndersonNews

RT @CancerFrontline: An @MDAndersonNews team developed a personalized vaccine that exposes evasive colorectal cancer to an immune attack ht…

2 hours ago
profile_image

Houston Methodist

houstonmethodist

Discover world-class career opportunities for experienced RNs at the Houston Methodist San Jacinto Hospital hiring event on 4.26 from noon-3 p.m. Bring several copies of your resume & park free in the visitor parking lot. Learn more: http://pxlme.me/1JA7A6zf

3 hours ago
profile_image

University of Houston

@UHouston

RT @UHCougarMGolf: .@UHouston alum & @CBSSports broadcasting great Jim Nantz reacts to being named 2018 Ambassador of Golf CONGRATS, Jim,…

4 hours ago
profile_image

BCMHouston

@bcmhouston

Sneezing, headaches and a stuffy nose always means you have allergies right? Wrong! https://t.co/wf8ti3TKVw

4 hours ago
profile_image

Baylor College of Medicine

BaylorCollegeOfMedicine

Congratulations to Dr. Yingbin Fu on earning the Helen Juanita Reed Award for Macular Degeneration from the BrightFocus Foundation.

4 hours ago
profile_image

Veterans Affairs

@DeptVetAffairs

New Mexico Veterans set sights on Golden Age Games competition - Volunteers needed for 32nd annual event in Albuquerque https://t.co/gS2J3VC4HZ via @Sports4Vets on #VAntagePoint

4 hours ago
profile_image

Veterans Affairs

@DeptVetAffairs

Telehealth education is on the move in Colorado https://t.co/KgB6D7Xt37 via @KREX5_Fox4

5 hours ago
profile_image

Veterans Affairs

@DeptVetAffairs

It's a new day at your Manchester VA https://t.co/lDrYdgumuw via @seacoastonline

6 hours ago
profile_image

Rice University

RiceUniversity

How can you make the last day of class even better? Bring some cute animals to campus! 🐰

6 hours ago
profile_image

UTHealth

@UTHealth

Did you know #stroke is the fifth leading cause of death and leading cause of disability in the U.S.? Come to our Stomp Out Stroke Festival from 9 a.m.-3:30 p.m. on Sat., April 28 @DiscoveryGreen to find out how to decrease your stroke risk. Register at https://t.co/PBNoFVY455. https://t.co/sYm9Ny734p

7 hours ago
profile_image

UTHealth

@UTHealth

RT @UTHealthSPA: FYI >>> NIH Funding Opportunities and Notices for April 20, 2018 https://t.co/VXvK9WVKy4 #grant #grants #research

7 hours ago
profile_image

UTHealth

@UTHealth

RT @uthpsychiatry: The UTHealth Center of Excellence on Mood Disorders is conducting a new clinical research study for adults with schizoph…

7 hours ago
profile_image

U.S. Department of Veterans Affairs

VeteransAffairs

Today’s #VeteranOfTheDay is Navy Veteran Tammie Jo Shults. Tammie Jo served for 10 years as a pilot and earned the rank of lieutenant commander. Tammie Jo grew up on a New Mexico ranch near Holloman Air Force Base where she developed her interest in flying. She attended MidAmerica Nazarene University, graduating in 1983. A year after taking the Navy aviation exam, Tammie Jo found a recruiter who processed her application. She attended officer candidate school in Pensacola, Florida, and was assigned to a training squadron at Naval Air Station Chase Field in Beeville, Texas. Tammie Jo was an instructor pilot, teaching students how to fly the Navy T-2 trainer. She later flew the A-7 Corsair in Lemoore, California. Tammie Jo was among the first female fighter pilots for the Navy and was the first woman to fly an F/A-18 Hornet. In 1993, after 10 years of service, she left the Navy. Earlier this week, Tammie Jo completed the successful emergency landing of Southwest flight 1380 at the Philadelphia International Airport. The Boeing 737-700 lost an engine, causing shrapnel to strike a window. With 148 people on board, one woman died and seven were injured. Thank you for your service, Tammie Jo.

7 hours ago
profile_image

TAMU Health Sciences

@TAMHSC

We are proud to "Teal Out" in support of #StepInStandUp! Even one such incident is too many. https://t.co/NQdJ5UyHkA

7 hours ago