Machine Learning and Artificial Intelligence (ML & AI) Services

SimInsights applies state of the art of machine learning and artificial intelligence techniques to address challenging problems across industries and use cases. The techniques range from computer vision, natural language processing, deep reinforcement learning and other traditional methods. Across use cases, our goal is to build immersive, intelligent and interactive software systems that can assess people’s knowledge, skills, affective and physiological states and personalize the experience to foster greater learning and performance. Our capable and highly motivated engineers are ready to assist both in-house as well as on-site, depending on customer requirements.


Actionable intelligence to support better and faster decisions

Intelligence is the next frontier for value creation. We help customers leverage the latest advances in software and intelligence to unlock new value. Our offerings include building data warehouses, applying data mining and machine learning techniques to build models for prediction and recommendation and deploying actionable systems in production. We have successfully helped our customers leverage intelligence in the areas of healthcare, performance tracking, assessment, personalized learning, manufacturing, finance, marketing and sales.

Machine learning based behavior analytics

VR literature suggests a causal chain from immersion via presence to performance (Cummings, et al, 2012) which offers unprecedented power for assessing human responses to diverse stimuli. One example is human factors evaluation of a new facility. However, the rich datasets pose a formidable challenge to analysts. Manual coding of behaviors can be challenging and time consuming. SimInsights is addressing this problem by using machine learning techniques to automatically recognize and classify complex behaviors and thereby evaluate new facility designs in a fraction of the time.

Computer vision applications

We are building power augmented reality applications for manufacturing and healthcare sectors. These apps require fast and accurate detection, recognition and tracking of objects and actions in a variety of environments, with varying constraints on computational resources and power. We are exploring both fixed and mobile cameras in conjunction with projectors and head mounted displays (HMD’s) to solve different use cases.

Natural Language Processing (NLP)

We are applying NLP techniques for building natural user interfaces in AR, VR and other applications. For example, conversational agents in Virtual Reality simulations can provide a high degree of engagement while also fostering deeper learning and retention. Voice assistants in Augmented Reality applications can help with getting tasks done in areas such as training, selling, product assembly and installation, design reviews, shopping etc. Question answering is a particular area of focus, with questions ranging from simple low-reasoning queries to more open ended high-reasoning queries.

Deep reinforcement learning (RL)

We are applying deep RL in simulated environments to train agents for a variety of applications ranging from increasing engagement in games to evaluating game levels. Recent advances by DeepMind (e.g. alphaZero) have opened up promising application areas for simulation based exploration and innovation, and we are excited to leverage the new techniques.

Machine learning for assessment of knowledge and skills

Bayesian Network models have been used in assessment to generate fine grained assessment for both summative and formative use. SimInsights has worked with academic researchers to apply Bayesian Networks and machine learning to assess knowledge and skills from observations of human performance in serious games and simulations. This multi-year collaboration has resulted in multiple research reports and software modules of increasing generality that can be applied to a range of inference problems. In addition to Bayesian methods, our team has also applied a variety of other techniques to assessment including Gaussian Mixture Models (GMM), clustering, partially observable markov decision problems (POMDP), hidden markov, markov chains, bandits and traditional item response theory (IRT) based methods.

Data warehouse and Business Intelligence (DW/BI) Systems

Data warehousing and Business Intelligence fields are undergoing disruption as Amazon and other cloud vendors release innovative tools at prices that are lower than traditional vendors by orders of magnitude. SimInsights is building highly customized Data Warehouse and Business Intelligence solutions with rapid turnaround times and competitive rates. We leverage already developed custom proprietary pre-built extraction interfaces with many popular vendors for telephony, CRM, loan origination, leads and other software services.

Learning analytics

With students learning anytime, anywhere, how can instructors keep up with what their students already know and what they need to know? We have developed analytics driven dashboards that provide formative feedback to instructors so they can provide help when its most needed and keep students motivated and progressing toward their goals.

Collaborative selling

Today, Google Docs and other apps are mainstream. But back in 2012, very few apps featured real time collaboration. At that time, we developed a relationship-mapping app that enabled Fortune 500 company key account executives to work together to achieve sales success by mapping relationships and sharing other information.


SimInsights portal not only offers a variety of apps, but every one of the apps (experiments, playlists, slides, games, simulations and quizzes) is instrumented with data logging. The data is processed using our proprietary data processing modules and is visualized using customized dashboards optimized for the analytics needs of users of each app. The dashboards allow performance visualization in real time so that instructors can assess how each learner is performing and then make personalized decisions about their next steps.

Our unique approach to intelligence development