

smart city screens

One of the foundations of a “Smart City” is to create an ecosystem that engages more actively with its citizens. We are reshaping our urban environments, and Smart Cities are becoming a reality. Experts in the field of public space are becoming increasingly aware of the importance of spaces that feel inviting for people to meet each other and stick around for discussion. Research is necessary to question, which social and urban situations occur around a screen, and how these situations can be identified and characterised. By exploring and creating forms of interactive content that are suitable for the specific context, we can reuse the content in different locations. Engagement is the relationship between people and their surroundings.

free speech

Speaker’s Corners in public spaces are meeting places to share expressions and practice free speech. However, information and knowledge sharing through digital means, and the Internet has become a popular soapbox. Although technology will not lead us to an information Utopia, the role of free speech as an inherent right could be better practiced. There is a threat to free speech. Comprehending the structure of free speech of current cyber-law allows us to pre-determine, and work for the future of free speech rights, and propose alternatives through other mediums. So what can we do to create new platforms, spaces, and open networks that continue to enable free speech in the future?

technical approach

Voice and speech recognition systems had not been integrated into our daily personal use until recently. The tools are now made accessible to a wider audience and people are experimenting with the technology in many ways, but typically for commercial purposes and without an affective feedback. There is a gap in the experimentation with creative speech, storytelling, poetry, singing, and other forms of meaningful word-use with computer systems. We produced and demonstrated how to visually communicate emotions from spoken word, which encourages the user to be more expressive within the context of public screen-mediated interactions. Features of kaleidOk include computing emotion from speech, retrieving images based on emotional input, and displaying them artistically with vocal attributes. The design is based both on empirical premise and our subjective criteria.

user response

The user testing showed that the use case of a more intimate screen interaction experience was most effective, so kaleidOk will continue as a console-based setup in public spaces. kaleidOk was deployed in a wide variety of contexts, from hackathons to a café-cinema, in a university, and public spaces. Through the observation and interviews it became apparent people are quite afraid of public speaking, speaking to a computer in general and expressing their emotions in a public setting. However, people are genuinely interested in the potential future applications of speech recognition based creative technologies. Based on user responses, kaleidOk is received as an innovative concept, it's interesting and engaging, it's aesthetically pleasing, it reflects the user's emotional input, and it makes the user more aware of their current emotional state.

installation guide.pdf

further work
