Design World

  • Home
  • Technologies
    • 3D CAD
    • Electronics • electrical
    • Fastening & Joining
    • Factory automation
    • Linear Motion
    • Motion Control
    • Test & Measurement
    • Sensors
    • Fluid power
  • Learn
    • Ebooks / Tech Tips
    • Engineering Week
    • Future of Design Engineering
    • MC² Motion Control Classrooms
    • Podcasts
    • Videos
    • Webinars
  • LEAP AWARDS
  • Leadership
    • 2022 Voting
    • 2021 Winners
  • Design Guide Library
  • Resources
    • 3D Cad Models
      • PARTsolutions
      • TraceParts
    • Digital Issues
      • Design World
      • EE World
    • Women in Engineering
  • Supplier Listings

How To Make An AI Forget

By Christopher Stanton | August 17, 2017

Share

We all know what it’s like to forget something. A loved one’s birthday. A childhood memory. Even people capable of extraordinary memory feats – say, memorising the order of a deck of cards in less than 20 seconds – will still forget where they left their keys. People, it seems, are never in complete control of their memories.

Forgetting is a tricky business, both for humans and for artificial intelligence (AI), and researchers are exploring the idea of robot memory in many different ways.

This raises not only technical issues, but concerns related to privacy, law and ethics. Imagine if your household robot witnessed you having a sneaky cigarette despite you promising your spouse that you had quit smoking? What about if they saw you commit a murder?

It’s an important question: who, if anyone, should have the power to make a robot forget what it witnessed? But first, researchers need to work out the best way to make AI to forget in the first place.

Why do people forget?

A popular metaphor to explain why people forget is that our brains become full, and thus we forget things to “make space”.

Yet some people have a rare condition called “hyperthymesia“, which allows them to remember almost every detail of their lives. This suggests that the idea of “fullness” is not the complete story.

So if we don’t forget things to make room for new memories, then why do we forget? One explanation is that memories help us understand the world, rather than merely to remember it. In this way, we seem to retain memories that are useful, valuable and relevant, while forgetting information of lower value.

For example, some studies suggest that people can be better at remembering conflicting information than repetitive information. Other factors include the importance and novelty of the event, as well as our emotions and mood at the time of the experience. Consider September 11, 2001 – many of us remember vividly where we were and what we were doing on that day.

How do robots forget?

Memory in computers is typically used to describe both its capacity to store information subject to recall, as well as the physical components of the computer in which such information is stored.

For example, a computer’s working memory “forgets” data when it is no longer needed for a task, freeing up computational resources for other tasks.

This also applies to AI, but while forgetting something might cause us frustration, it is the way in which we forget that makes people still superior to AI. Machine learning algorithms in particular are poor at knowing when to keep old information and when to discard outdated information.

For example, connectionist AI (AI that often uses neural networks modelled on the structure of the brain) faces several problems related to “forgetting”. These include over-fitting, which is when a learning machine stores overly detailed information from past experiences, hindering its ability to generalise and predict future events.

Another problem is “catastrophic forgetting“. Researchers are trying to build artificial neural networks that can appropriately adjust to new information without abruptly forgetting what they learned before.

Finally, sometimes the neurons of an artificial neural network adopt undesirable activation patterns early in the learning process, damaging the future learning ability of the AI.

An alternative approach to storing memories in robots is symbolic memory representations where knowledge is represented by logical facts (“birds fly”, “Tweety is a bird”, so therefore, “Tweety can fly”). These highly structured human-created representations can be easily deleted, just like deleting a file on a computer.

These memories can range in fidelity from raw sensorimotor data (a recording from a camera) to logical facts stored in a knowledge base (“Christmas Day is the 25th of December”).

What should robots forget?

Understanding how our brains decide what is worth remembering and what is worth forgetting is important for creating better AI.

Just like people, AI should remember important and useful information, while forgetting low value, irrelevant knowledge. However, determining what is relevant and valuable may include factors besides the task at hand, such as questions of ethics, law and privacy.

Chatbots make medical diagnoses, smart home devices monitor our movements and security robots perform patrols with videos cameras and thermal imaging. That’s a lot of stored data.

Amazon’s home assistant Echo, for example, is a voice-controlled hands-free speaker that is always listening for a command prompt. Arkansas police recently demanded that Amazon turn over information apparently collected from a murder suspect’s Echo.

Alternatively, consider the AI in sex bots. Should sex bots remember or forget their clients, and what those clients did with them? Who owns the robot’s data, and who can view it and delete it?

When it comes to memories, deciding when a robot should forget is a profoundly human challenge.


Filed Under: M2M (machine to machine)

 

Related Articles Read More >

Part 6: IDE and other software for connectivity and IoT design work
Part 4: Edge computing and gateways proliferate for industrial machinery
Part 3: Trends in Ethernet, PoE, IO-Link, HIPERFACE, and single-cable solutions
Machine Learning for Sensors

DESIGN GUIDE LIBRARY

“motion

Enews Sign Up

Motion Control Classroom

Design World Digital Edition

cover

Browse the most current issue of Design World and back issues in an easy to use high quality format. Clip, share and download with the leading design engineering magazine today.

EDABoard the Forum for Electronics

Top global problem solving EE forum covering Microcontrollers, DSP, Networking, Analog and Digital Design, RF, Power Electronics, PCB Routing and much more

EDABoard: Forum for electronics

Sponsored Content

  • Global supply needs drive increased manufacturing footprint development
  • How to Increase Rotational Capacity for a Retaining Ring
  • Cordis high resolution electronic proportional pressure controls
  • WAGO’s custom designed interface wiring system making industrial applications easier
  • 10 Reasons to Specify Valve Manifolds
  • Case study: How a 3D-printed tool saved thousands of hours and dollars

Design World Podcasts

May 17, 2022
Another view on additive and the aerospace industry
See More >
Engineering Exchange

The Engineering Exchange is a global educational networking community for engineers.

Connect, share, and learn today »

Design World
  • Advertising
  • About us
  • Contact
  • Manage your Design World Subscription
  • Subscribe
  • Design World Digital Network
  • Engineering White Papers
  • LEAP AWARDS

Copyright © 2022 WTWH Media LLC. All Rights Reserved. The material on this site may not be reproduced, distributed, transmitted, cached or otherwise used, except with the prior written permission of WTWH Media
Privacy Policy | Advertising | About Us

Search Design World

  • Home
  • Technologies
    • 3D CAD
    • Electronics • electrical
    • Fastening & Joining
    • Factory automation
    • Linear Motion
    • Motion Control
    • Test & Measurement
    • Sensors
    • Fluid power
  • Learn
    • Ebooks / Tech Tips
    • Engineering Week
    • Future of Design Engineering
    • MC² Motion Control Classrooms
    • Podcasts
    • Videos
    • Webinars
  • LEAP AWARDS
  • Leadership
    • 2022 Voting
    • 2021 Winners
  • Design Guide Library
  • Resources
    • 3D Cad Models
      • PARTsolutions
      • TraceParts
    • Digital Issues
      • Design World
      • EE World
    • Women in Engineering
  • Supplier Listings