Embedding Machine Learning enables integrating intelligence in recent application domains such as Internet of Things, portable healthcare systems, and wearable devices. This paper presents an assessment of approximate computing methods at algorithmic, architecture, and circuit levels and draws perspectives for further developments and applications. The main goal is to investigate how approximate computing may reduce the complexity and enable the feasibility of embedded Machine Learning (ML) systems. Though ML is a powerful paradigm for applications in the perceptual domain (i.e. vision, touch, hearing, etc.), their computational complexity is very high and consequently real time operation and ultra-low power are still very challenging objectives. On the other hand, approximate computing has emerged as an effective solution to reduce hardware complexity, time latency and to increase energy efficiency.