What Do Sofware Engineers Care About? Gaps between Research and Practice Vladimir Ivanov Innopolis University, Russia v.ivanov@innopolis.ru Alan Rogers Innopolis University, Russia a.rogers@innopolis.ru Giancarlo Succi Innopolis University, Russia g.succi@innopolis.ru Jooyong Yi Innopolis University, Russia j.yi@innopolis.ru Vasilii Zorin Innopolis University, Russia v.zorin@innopolis.ru ABSTRACT It is a cliché to say that there is a gap between research and practice. As the interest and importance in the practical impact of research has been growing, the gap between research and practice is ex- pected to be narrowing. However, our study reveals that there still seems to be a wide gap. We survey software engineers about what they care about when developing software. We then compare our survey results with the research topics of the papers published in ICSE/FSE recently. We found the following discrepancy: while software engineers care more about software development produc- tivity than the quality of software, papers on research areas closely related to software productivityÐsuch as software development process management and software development techniquesÐare signifcantly less published than papers on software verifcation and validation that account for more than half of publications. We also found that software engineers are in great need for techniques for accurate efort estimation, and they are not necessarily knowl- edgable about techniques they can use to meet their needs. CCS CONCEPTS · Social and professional topics Industry statistics; · Soft- ware and its engineering Software creation and manage- ment; KEYWORDS Software Engineering Research and Practice, Survey ACM Reference format: Vladimir Ivanov, Alan Rogers, Giancarlo Succi, Jooyong Yi, and Vasilii Zorin. 2017. What Do Software Engineers Care About? Gaps between Research and Practice. In Proceedings of 2017 11th Joint Meeting of the European Software Engineering Conference and the ACM SIGSOFT Symposium on the Foundations of Software Engineering, Paderborn, Germany, September 4ś8, 2017 (ESEC/FSE’17), 6 pages. https://doi.org/10.1145/3106237.3117778 Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for proft or commercial advantage and that copies bear this notice and the full citation on the frst page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specifc permission and/or a fee. Request permissions from permissions@acm.org. ESEC/FSE’17, September 4ś8, 2017, Paderborn, Germany © 2017 Association for Computing Machinery. ACM ISBN 978-1-4503-5105-8/17/09. . . $15.00 https://doi.org/10.1145/3106237.3117778 1 INTRODUCTION Industrial impact has been gaining attention of many researchers nowadays. Industry tracks, such as ESEC/FSE industry track, have provided for researchers pathways to industrial impact. Typically, researchers team up with industry partners and apply research re- sults to real-world problems of industry. As a result, the doorway to tech-transfer has widened ś research results developed in academia are being transferred to industry through this doorway. In this paper we consider the opposite direction, that is, the transfer of industry problems to academia. In other words, we analyze whether software engineering (SE) researchers are solving problems that industry practitionersÐmore specifcally, software engineersścare about. Given limited resources available for research as compared to the gigantic size of software industry, researchers need to be strategic in order to maximize their impact. We are not arguing here that researchers should tackle only the problems practitioners care about. The traditional research efort of exploring new ideas without being necessarily constrained by industry needs should be continued. However, if the aim of a researcher is to make an impact on industry, understanding what practitioners care about can be a useful guideline to achieve the aim. Pushing Research to Practice. The ACM SIGSOFT Impact project assesses the impact of SE research on practice [24]. Under this um- brella project, diverse SE research feldsÐsuch as programming languages [28], software confguration management [10], runtime assertion checking [7], middleware technology [9], and code in- spections and reviews [27]Ðhave been assessed about their impact on practice. Inspired by the Impact project, Lo et al. [19] performed a lightweight survey with software engineers working in Microsoft to investigate how software engineers perceive SE research. The as- sessment of these previous studies is generally positive: SE research has made an impact on practice [24], and the current SE research seems generally relevant to SE practices exercised in Microsoft [19]. Pulling Practical Needs from Industry. While these previous studies investigate the fow from research to practice as to how impactful and healthy the research-to-practice fow is, the opposite direction of the fowÐfrom practice to researchÐis relatively rarely studied. In other words, there has been little research done on the issue of łwhat industry wants from research"Ðincidentally, how- ever, ICSE 2011 hosted a panel with this same title. The following excerpt from the abstract of the panel casts a diferent shade from the aforementioned studies: łHalf of the people who attended the frst 890