This paper seeks to explore the history of artificial intelligence (AI) and explainable AI (XAI), including its recent role in a multitude of disciplines, such as healthcare, finance and law. The paper seeks to explore both the advantages and disadvantages of deploying XAI in the concerned fields and to visualise its use in the future.