As we write this research paper, we notice an explosion in popularity of machine learning in numerous fields (ranging from governance, education, and management to criminal justice, fraud detection, and internet of things). In this contribution, rather than focusing on any of those fields, which have been well-reviewed already, we decided to concentrate on a series of more recent applications of deep learning models and technologies that have only recently gained significant track in the relevant literature. These applications are concerned (...) with artistic production (Sect. 2.1), the writing process (Sect. 2.2), music production (Sect. 2.3), text recognition and attribution (Sect. 2.4). After reviewing and analyzing the positive contributions as well as some of the major limitations of these technologies in each of those fields, we critically reflect (Sect. 3) on how their widespread implementation may affect humans and their creativity. In Sect. 4, we notice that deep learning models are here to stay; so, rather than embracing a negative or pessimistic stance with respect to their future applications in creative domains, we suggest a balanced approach for their assessment and beneficial usage. Finally (Sect. 5), we conclude by summarising what we have achieved and by pointing out possible future research directions. (shrink)