In the paper the issues of the transport systems operation quality assessment are considered. The studies take into consideration the real complex sociotechnical (H – M E) (human – machine – environment) systems. The assessment quality of the systems operation is based on the changes of the systems features values. The features describe the operation of the systems operators, controlled technical objects (vessels, trains, planes or cars) and the environment influence. The assessment and the support the demand quality of the systems operation from the safety, efficiency, economic and reliability point of view is the basic factor of the executed exploitation process. The paper deals with description of rules, on the basis of which the method has been developed. Algorithm of mathematical model of the systems operation quality evaluation has been built. Metrics have been elaborated, essential concepts of metric space have been used and partial order relation as well as appropriate setting systems in order in terms of their operation quality has been applied. The model can serve as a general abstract form for operation quality evaluation of a wide range of real transport systems differing with properties, structure and operation. operation quality, transport system, model, metric. I. INVESTIGATION OBJECT ll the considerations deal with transport systems performing transportation of passengers and cargo over water, land and air routes. The main operation aim of such systems is realization of transport service within a specific environment, within specific quantity and within specific time by means of technical objects being operated and maintained within the system range. Having in mind the considerations presented above, based on identifying and analysing the real transport systems it has been determined that the following subsystems may be set on individual levels of their decomposition: 1. logistic, within the ranges of which the actions related to managing the system, information flow and processing as well as keeping usefulness state of the transport means operated and maintained within the system are performed, which is composed of: decisionmaking subsystem, maintenance subsystem, information subsystem, 2. executive, in which the essential aim of the system is being realized – which is providing the transport service, 3. environment – as a coworking subsystem. A general scheme of the operation and maintenance system of the transport means is presented in the Figure 1. The research aim is to present a method, assessment and control way of operation quality for complex sociotechnical systems, depending on actions of operators, the machine operation and the impact of factors coming from the environment. Fig. 1. A general scheme of the operation and maintenance system of the transport means II. SYSTEMS OPERATION QUALITY This point includes description of the rules, on the basis of which a method to evaluate the quality of the transport system operation has been formulated. As it can be seen in Figure 2, an external observer EO determines the criteria set to evaluate quality of the system operation K. Afterwards he identifies the investigation object, and on this basis he sets the set of features X describing the system from the point of view of its operation quality. On the basis of analysing the relevant literature and our own investigations it has been defined that: the operation quality of the system is a set of the system features expressed by means of their numeral values at a given moment t, determining the level of accomplishing the required conditions [3]. In this paper, the criterion term has been defined as one of the significant conditions, imposed on the feature value, which describes the quality of the analysis subject at a given moment t. A feature is a property or quality of the analysis subject. We call a property such a feature which is common for all the subjects which is expressed as a physical quantity, whereas a quality we call such a feature which lets us distinguish some objects which do not have these features [4]. The evaluation method of human – machine system operation quality Łukasz Muślewski, Maciej Woropay, Piotr Bojar, Janusz Szpytko A Decision making subsystem Information subsystem Maintenance subsystem EXECUTIVE SUBSYSTEM ENVIRONMENT TRANSPORT SYSTEM LOGISTIC SUBSYSTEM LATEST TRENDS on APPLIED MATHEMATICS, SIMULATION, MODELLING ISSN: 1792-4332 220 ISBN: 978-960-474-210-3