During the past decade, recommender systems have rapidly become an indispensable element of websites, apps, and other platforms that seek to provide personalized interactions to their users. As recommendation technologies are applied to an ever-growing array of non-standard problems and scenarios, researchers and practitioners are also increasingly faced with challenges of dealing with greater variety and complexity in the inputs to those recommender systems. For example, there has been more reliance on fine-grained user signals as inputs rather than simple ratings or likes. Applications require more complex domain-specific constraints on inputs to the recommender systems. Likewise, the outputs of recommender systems are moving towards more complex composite items, such as package or sequence recommendations. This increasing complexity requires smarter recommender algorithms that can deal with this diversity in inputs and outputs. For the past four years, the ComplexRec workshop series has offered an interactive venue for discussing approaches to recommendation in complex scenarios that have no simple one-size-fits-all solution. @en

Fairness is one of the crucial aspects of modern Recommender Systems which has recently drawn substantial attention from the community. Many recent works have addressed this aspect by studying the fairness of the recommendation through different forms of evaluation methodologies and metrics. However, the majority of these works have mainly concentrated on the recommendation algorithms and hence measured the fairness from the algorithmic viewpoint. While such viewpoint may still play an important role, it does not necessarily project a comprehensive picture of how the users may perceive the overall fairness of a recommender system. This paper extends the prior works and goes beyond the algorithmic fairness in recommender systems by highlighting the non-algorithmic viewpoint on the fairness in these systems. The paper proposes an evaluation methodology that can be used to assess the fairness of a recommender system perceived by its users. We have adopted a well-known model and re-formulated it to suit the particular characteristics of the recommender systems, and accordingly, their corresponding users. Our proposed methodology can be used in order to elicit the feedback of the users, along with three important dimensions, i.e., Engagement, Representation, and Action & Expression. We have formed a set of survey questions that address the aforementioned dimensions, as a set of examples to assess the fairness in a recommender system. @en