The essay aims to provide an overview of existing research on moral cognition and its neural correlates, as well as to highlight aspects in which the findings from the field of cognitive neuroscience can add to the understanding of the challenges that arise from having artificial systems as moral decision-makers. Morality is an important characteristic of the human way of life and a central mechanism in the modern society. Research suggests that morality has evolved as a function to promote cooperation and prosocial behaviour. Morality has been a topic of investigation in several interdisciplinary fields and often includes the exploration of reason and emotion and their respective roles. Contemporary technological advances include the increased presence of artificial intelligence (AI) that aims to simulate the human mind. Empirical evidence suggests that deontological responses are more closely related to emotional components of moral cognition and linked to increased activity in the ventromedial prefrontal cortex. In contrast, utilitarian responses appear to be more reliant on reason and a more complex neural network that is linked to increased activity in primarily dorsolateral prefrontal cortex. AI has successfully accomplished certain elements of simulating human cognition. However, key findings suggest that the integration of reason and emotion is essential which is possibly challenging for AI to fully replicate.