Steve Mann: Pioneer of Wearables and Extended Reality

Though head-mounted computer systems haven’t reached smartphone-level ubiquity, when Mann wears XR (eXtended Reality, one thing he and Charles Wyckoff invented at MIT in 1991) gear today as a professor {of electrical} and computer engineering, laptop science, and forestry on the University of Toronto, he doesn’t flip as many heads as he used to.

Partly due to his inventiveness and creativity, the IEEE Fellow was honored for his contributions to wearable computing and the idea of sousveillance—the follow of utilizing private recording units to observe the watchers and invert conventional surveillance energy buildings—with this yr’s IEEE Masaru Ibuka Consumer Technology Award. Sponsored by Sony, the award was bestowed by the IEEE Consumer Technology Society on the Consumer Electronics Show held in January in Las Vegas.

Mann is considered the “father of wearable computing.” Requested what he thinks in regards to the moniker, he says it’s much less in regards to the title and extra about empowering folks to see the world—and themselves—in new methods.

His analysis and systematic reimagining of how digital units can assist and prolong human talents, particularly imaginative and prescient, have yielded advantages for society. Amongst them are aiding the visually impaired with the power to determine objects and enabling specialists to remotely view what frontline employees see after which information them from afar.

His IEEE award got here one month after he obtained the Lifeboat Foundation’s Guardian Award, given to a scientist or public determine “who has warned of a future fraught with risks and inspired measures to stop them.” The inspiration is a nonprofit, nongovernmental group devoted to encouraging scientific developments whereas serving to humanity survive existential dangers and doable misuse of more and more highly effective applied sciences together with genetic engineering, nanotechnology, and robotics/AI.

A natural-born tinkerer

It stands to cause that Mann would turn into a number one tinkerer. His earliest recollections are of welding together with his grandfather and knitting together with his grandmother—uncommon hobbies for a typical 4-year-old, although not in Mann’s household. His father, who labored for a males’s clothes firm, supplemented his revenue by shopping for and renovating homes, lengthy earlier than the idea of flipping houses grew to become widespread.

“We had been at all times residing in a home beneath development,” Mann recollects. “I used to assist my dad make things better after I was 4 or 5—hammer in my hand—regular stuff.” His grandfather, a refrigeration engineer, taught him the best way to weld. By age 6, he was wiring and constructing home made radios. By the point he was 8, he had began a neighborhood restore enterprise, fixing televisions and radios.

“In a way, preschool for me was studying engineering and science,” Mann says with amusing. “I grew up placing collectively wooden, steel, or material. I knew the best way to make issues at a really younger age.”

Studying to see what others miss

When Mann was 12 years previous, his father introduced house a damaged oscillograph (an early model of the oscilloscope, used to show variations in voltage or present as visible waveforms). It turned out to be a defining second in his life. Too impatient to simply accept that the waveform dot on the machine’s show moved solely up and down as an alternative of each vertically and horizontally, Mann invented a strategy to push its picture by means of bodily area.

He positioned the oscillograph—which he now retains on a shelf in his laboratory—on a board mounted on curler skate wheels. He linked the machine to a police radar and rolled it forwards and backwards. When he realized the machine’s movement, mixed with the dot’s vertical motion, created seen waveforms of the radar’s alerts, as a operate of area slightly than time, he unknowingly made a revolutionary discovery.

Later he would describe that merging of bodily and virtual worlds as “prolonged actuality”—an idea that underlies immediately’s AR and XR applied sciences. It wouldn’t be the final time Mann’s curiosity turned an issue into a chance.

A long time later, on the principle flooring of his Toronto house, he co-founded InteraXon, the Toronto-based firm behind the Muse brain-sensing headband, used to assist folks handle sleep, stress, and mental health.

Mann shares legendary Nineteen Seventies Xerox PARC researcher Alan Kay’s perception that “The best way to predict the future is to invent it.” Mann, nevertheless, provides: “Typically you invent it by merely refusing to simply accept the constraints of the current.”

A member of MIT’s Media Lab

In highschool, Mann gained a number of math competitions designed to problem college students at college stage. In 1982 he enrolled in McMaster University, in Hamilton, Ontario, to pursue a level in engineering physics (an interdisciplinary program that mixes physics, mathematics, and engineering ideas). As an undergraduate, Mann was already experimenting with early prototypes of wearable computer systems—head-mounted shows, body-worn cameras, and transportable computing programs that predated mainstream cellular tech by a long time.

Mann [far right] sits alongside fellow MIT Media Lab graduate college students, modeling the wearable computers or smart clothes they had been creating as a part of their Ph.D. analysis. Pam Berry/The Boston Globe/Getty Pictures

He earned a bachelor’s diploma in 1986. He continued his research at McMaster to earn a second bachelor’s diploma in electrical engineering in 1989, then a grasp’s diploma in engineering in 1991.

He then enrolled in a doctoral program at MIT, the place he joined its famend Media Lab, a hotbed for unconventional analysis mixing know-how, design, and the human expertise. He formalized and expanded his concepts round wearable computing, wearable laptop imaginative and prescient programs, and wearable AI. He additionally printed among the earliest educational papers that described the idea of sousveillance.

He accomplished his Ph.D. in media arts and sciences in 1997.

Mann’s doctoral analysis contributed foundational ideas and {hardware} that influenced future smart glasses and units for all times logging, the follow of making a digital report of 1’s each day life. He additionally helped blaze a path for the fields of augmented reality and ubiquitous computing.

Knitting passions into a singular educational profession

After finishing his Ph.D., Mann returned to Canada and took a place on the College of Toronto as a professor {of electrical} and laptop engineering in 1998. He says he’s equally as fascinated by how know-how interacts with the pure world as he’s by the best way to take away boundaries between the bodily world and virtual world.

His pursuits hook up with what he calls “vironmentalism,” which regards know-how as a boundary between our surroundings and our “vironment” (ourselves). This provides rise to his imaginative and prescient of “mersive” applied sciences that hyperlink people not simply to one another but in addition to the atmosphere round them.

“Transcend [what’s covered at] college. Outline your self by what you’re keen on a lot you’d do it [even if no teachers or managers were demanding it]. AI can exchange a strolling encyclopedia. It may’t exchange ardour.”

“It’s advancing know-how for humanity and Earth,” he says, riffing on IEEE’s mission assertion. His guideline additionally explains his cross-appointment within the College of Toronto’s forestry division (now a part of the School of Structure, Panorama, and Design)—an uncommon entry on {an electrical} and laptop engineering professor’s CV.

IEEE and constructing group

Previous to his groundbreaking doctoral work at MIT, Mann had already joined IEEE in 1988. He credit the group with connecting him to pioneers like Simon Haykin, the radar visionary he met at McMaster whereas he was in highschool. Haykin pushed him to dream large, he says.

Mann has been energetic within the IEEE Computer and IEEE Consumer Technology societies. He has served as an organizer, session chair, and program committee member for IEEE conferences associated to wearable computing and pervasive sensing.

In 1997 he helped discovered the International Symposium on Wearable Computers, and quite a few different wearable computing symposia, conferences, and occasions.

He has given keynote talks and introduced papers on matters together with sousveillance, ubiquitous computing, and different humanistic facets of know-how on the IEEE International Symposium on Technology and Society and the IEEE International Conference on Pervasive Computing and Communications.

His contributions embody influential papers in IEEE journals, particularly numerous IEEE Transactions and Laptop Society magazines.

In all probability his most well-known paper is “Wearable Computing.” Revealed in Computer journal in October 1997, the seminal work outlined the construction and imaginative and prescient for wearable computing as a proper analysis area. He additionally contributed articles on sousveillance—exploring the intersection of know-how, ethics, and human rights—in IEEE Technology and Society Magazine.

He has collaborated with different IEEE members to develop frameworks for wearable computing standards, significantly round human-computer interfaces and privateness issues.

Perpetually the inventor

Mann continues to show, run his lab, and take a look at new frontiers of wearable devices, smart clothing, and immersive environments. He’s nonetheless pushed, he says, by the identical forces that powered his yard experiments as a toddler: curiosity and fervour.

For college students who hope to observe in his footsteps, Mann’s recommendation is easy: “Transcend [what’s covered at] college. Don’t outline your self by the lessons you took or the roles you had. Outline your self by what you’re keen on a lot you’d do it “even when no lecturers or managers had been demanding it”. He provides that, “AI can exchange a strolling encyclopedia. It may’t exchange ardour.”

Mann says he has no plans to retire. If something, he says, his best years are but to return.

“I really feel like I’m a late bloomer,” he says, chuckling on the irony. “I used to be fixing radios after I was 8, however my finest work? That’s going to occur between 65 and 85.”