+1 Recommend
1 collections

      To submit your manuscript, please click here

      • Record: found
      • Abstract: found
      • Article: found
      Is Open Access

      Comparison of Housing First and Traditional Homeless Service Users in Eight European Countries: Protocol for a Mixed Methods, Multi-Site Study


      Read this article at

          There is no author summary for this article yet. Authors can add summaries to their articles on ScienceOpen to make them more accessible to a non-specialist audience.



          Homeless services expend considerable resources to provide for service users’ most basic needs, such as food and shelter, but their track record for ending homelessness is disappointing. An alternative model, Housing First, reversed the order of services so that homeless individuals are offered immediate access to independent housing, with wraparound supports but no treatment or abstinence requirements. Although the evidence base for Housing First’s effectiveness in ending homelessness is robust, less is known about its effectiveness in promoting recovery.


          The objective of this research is to compare rehabilitation- and recovery-related outcomes of homeless services users who are engaged in either Housing First or traditional staircase services in eight European countries: France, Ireland, Italy, the Netherlands, Poland, Portugal, Spain, and Sweden.


          A mixed methods, multi-site investigation of Housing First and traditional services will compare quantitative outcomes at two time points. Key rehabilitation outcomes include stable housing and psychiatric symptoms. Key growth outcomes include community integration and acquired capabilities. Semistructured interviews will be used to examine service users’ experiences of environmental constraints and affordances on acquired capabilities to identify features of homeless services that enhance service users’ capabilities sets. Multi-level modelling will be used to test for group differences—Housing First versus traditional services—on key outcome variables. Thematic analysis will be used to understand the ways in which service users make sense of internal and external affordances and constraints on capabilities.


          The study is registered with the European Commission (registration number: H2020-SC6-REVINEQUAL-2016/ GA726997). Two press releases, a research report to the funding body, two peer-reviewed articles, and an e-book chapter are planned for dissemination of the final results. The project was funded from September 2016 through September 2019. Expected results will be disseminated in 2019 and 2020.


          We will use the findings from this research to formulate recommendations for European social policy on the configuration of homeless services and the scaling up and scaling out of Housing First programs. From our findings, we will draw conclusions about the setting features that promote individuals’ exits from homelessness, rehabilitation, and recovery.

          International Registered Report Identifier (IRRID)


          Related collections

          Most cited references37

          • Record: found
          • Abstract: found
          • Article: found
          Is Open Access

          The At Home/Chez Soi trial protocol: a pragmatic, multi-site, randomised controlled trial of a Housing First intervention for homeless individuals with mental illness in five Canadian cities

          Introduction Background and rationale The prevalence of mental health problems and addictions among homeless people is significantly higher than in the general population.1–3 Mental health problems among people who are homeless include severe and persistent mental illnesses such as schizophrenia, as well as more prevalent conditions such as mood and affective disorders.3 The co-occurrence of mental disorders and substance abuse is also common in this group, particularly among single men.1 2 While people with severe and persistent mental illness form a minority among the homeless population, with a pooled estimated prevalence for psychotic disorders of 12.7%,4 they are more likely to experience repeated episodes and longer periods of homelessness, as well as to require more health and social services than others experiencing homelessness.5 To date, a small number of controlled trials, all conducted in the USA,6 have examined the effectiveness of housing and support interventions for people with mental illness who are homeless. This research reveals that programs providing housing combined with supports to people with severe mental illness are effective in reducing homelessness and hospitalisations and in producing other positive outcomes (eg, well-being). Housing First involves providing homeless people with immediate access to subsidised housing, together with supports. No pre-conditions, such as bringing substance abuse under control or being stabilised on medications, are imposed. In the 1980s, Pathways to Housing in New York City introduced a consumer choice-oriented variant of Housing First, in which clients are offered their choice of subsidised scattered-site apartments (as opposed to one-size-fits-all congregate housing). Clients who have severe mental illness in addition to being homeless are also offered the support of a multidisciplinary team, following a well-defined program model called assertive community treatment (ACT). A number of studies have examined the effectiveness of Pathways to Housing in delivering housing and support services to people with severe mental illness including individuals with concurrent disorders.7–11 Based on these studies, Pathways to Housing has emerged as an empirically supported intervention for people with severe mental illness who are homeless, including those with concurrent disorders. It has now been implemented in Calgary and Edmonton, Alberta and in several US cities.12 Because of differences in healthcare and social policies between the USA and Canada, it is not known if the Pathways to Housing approach will prove to be effective in the Canadian context, or more broadly in other international contexts. Moreover, it is not known if the approach will be equally effective among different sub-populations (eg, defined by gender, age, presence of concurrent disorders, Aboriginal status and immigration status) located in different cities across Canada. Further, while previous research examining Pathways to Housing focused on outcomes such as housing stability, housing problems, psychiatric symptoms, substance use, service utilisation and perceived housing choice, none of the studies examined other important outcomes of interest, such as community integration, social functioning, employment, recovery or physical health. As well, the cost-benefit or cost-effectiveness of the program compared to standard care was not evaluated. Finally, the Pathways to Housing studies did not incorporate a fidelity assessment to determine if the key elements of the approach were implemented nor did they examine how fidelity related to outcomes. Developed independently in Toronto, Streets to Homes is a Canadian variant of Housing First,13 which Toronto City Council initiated in 2005 as a strategy for ending street homelessness. The Canadian and US programs share many of the same elements such as services to assist people to find and move into housing of their choice followed by supports, so they can be successfully and stably housed. However, the Streets to Homes program uses intensive case management (ICM) rather than ACT as the service delivery model and serves a broader population than Pathways to Housing, as it includes all those who are on the streets rather than targeting only those with severe mental illness. While no published study evaluates Streets to Homes directly, two US studies suggest that this approach may be effective in providing care to a lower need subgroup that has otherwise not been included in much of the published literature.14 15 Both studies examined interventions targeting veterans of the armed forces in the USA. Using an experimental design, Rosenheck et al 15 compared the effectiveness of housing and support in the form of comprehensive case management to standard care. The study found that the combined housing and support approach was superior to standard care in achieving housing stability and reducing hospitalisations and prison stays. In the other study, O'Connell et al 14 used a quasi-experimental design to evaluate the effectiveness of regular housing and case management compared to the traditional approach of multistage continuum housing. Both groups showed significant improvements in housing outcomes, clinical status, community functioning and quality of life. Multistage housing participants, who had more difficulties in these areas at baseline, experienced greater improvement to the point that they were not significantly different from participants accessing regular housing and case management after 24 months. Residents in multistage housing, however, had significantly greater healthcare costs, due to greater use of inpatient care. Given the promising evidence of the Housing First model and interest in the less expensive ICM support approach, the present study was designed to stratify individuals by need level and evaluate these two service delivery variants. The research design is a pragmatic, multi-site field trial of the effectiveness of Housing First with concomitant economic and qualitative process evaluations. It is intended to provide policy-relevant evidence about whether a complex housing and support intervention works under real life conditions in five Canadian cities. This demonstration project includes funding for the implementation of the intervention through contracts with existing service agencies and rent supplements for participants. In order to ensure local buy-in and to develop innovative Housing First services that are tailored to local circumstances, each city had the option of defining a third intervention arm that was specific to their site (described below). This paper describes the study protocol including core quantitative research questions and methods that are common to all sites. It also includes an adaptation of the standard CONSORT description of pragmatic16 trials of non-pharmacological17 and complex interventions.18 Planning for the study began in the spring of 2008, first participants were recruited in the autumn of 2009, and data collection is to be completed in the spring of 2013. Objectives The At Home/Chez Soi study seeks to involve a range of stakeholders in a collaborative research and knowledge translation process that addresses the following objectives: To determine whether Housing First results in better outcomes than treatment as usual (TAU) for unaccompanied homeless adults with high and moderate needs living in five urban settings with respect to: (a) housing stability; (b) quality of life; (c) medical, psychological and physical health status; (d) social functioning; and (e) community integration. To examine the cost-effectiveness of Housing First in comparison to TAU. To examine the correlates of different trajectories of interest such as housing stability, mental health, medical conditions and employment over time. To identify the critical ingredients of the Housing First model and what modifications are needed to effectively serve particular sub-populations (eg, Aboriginals, ethnic groups, those living in congregate or rural settings). Methods and analysis Design The study's basic design is a randomised controlled trial (RCT) that is being conducted in five cities in Canada: Vancouver, British Columbia; Winnipeg, Manitoba; Toronto, Ontario; Montreal, Quebec; and Moncton, New Brunswick. Prior to randomisation, participants at all sites except Moncton are stratified according to the severity of their psychiatric problems into High Need or Moderate Need groups. Those in the High Need group are randomised into Housing First and ACT (HF+ACT) or TAU, while those with Moderate Need are randomised to Housing First and ICM (HF+ICM) or TAU. In Moncton, there are not enough people who are homeless to allow for a stratified design, so all participants are randomised to HF+ACT or TAU, although the team responds flexibly to individual needs. All sites have been given the option of an additional third arm. A typical design for one site is presented in figure 1. Figure 1 Vancouver study design. CONG, congregate housing and supportive services (site-specific arm); HF+ACT, Housing First and assertive community treatment; HF+ICM, Housing First and intensive case management; TAU, Treatment as usual. In Vancouver (as indicated in figure 1), and also in Winnipeg, Toronto and Montreal, participants are being randomised to a third site-specific intervention arm, in addition to HF+ACT and HF+ICM. In Vancouver, this intervention consists of congregate housing (a former hotel in which all of the residents are formerly homeless people with a mental illness) or project-based housing, which is a variation on Housing First that has been found effective with homeless substance using clients.19 In Winnipeg, the intervention is an Aboriginal peer support model for the moderate need group. In Toronto, an ICM intervention specifically for ethno-racial minorities is being tested for moderate need participants. In Montreal, moderate need participants are being randomised to an institutional versus a non-profit community-based ICM provider; both groups of participants are also invited to participate in a trial of supported employment. Moncton does not have a third arm, but there is a small, pilot project of Housing First in a rural setting. Details of the site-specific interventions are described in appendix 1. Recruitment and data collection Strategies to ensure adequate participation include seeking referrals from a wide variety of community agencies that serve the homeless, including shelters, drop-in centres, outreach teams, mental health teams, inpatient programs and criminal justice programs. Brochures describing the study and the eligibility criteria have been distributed and local service providers have provided advice about recruitment settings and procedures. Participants will be followed for 2 years after enrolment. Face-to-face follow-up interviews are being conducted at 6, 12, 18 and 24 months, and telephone interviews at 3, 9, 15 and 21 months. Due to the inclusion of questionnaires on service use and housing trajectories (unavoidable given study objectives), blinding of interviewers was infeasible. The schedule of instruments administered at each interview session is presented in table 1. A more detailed description of the instruments can be found in appendix 2. The number and timing of the interview sessions were dictated by two considerations: a desire to track the longer term trajectory of change for each individual; and recognition of the fact that it is likely that, due to the nature of their problems, some participants, especially in the TAU groups, may miss appointments. The statistical techniques that will be used (described below) can deal with missing data, as long as there are at least three data collection points for a given outcome measure, so that the frequency of the interviews maximises the number of people whose data can be analysed. Table 1 Key outcome and process domains and administration schedule Domain Variables Instruments Housing Stability Perceived quality Observer-rated quality Residential Time-Line Follow-Back Inventory20 * Perceived Housing Quality Scale21 22 Purpose developed observer-rated Housing Quality Scale Health status Mental Physical Modified Colorado Symptom Index (CSI)23 Global Assessment of Individual Needs GAIN Substance Problem Scale24 25 EQ-5D Visual Analog Scale26–28 Functioning including community integration, recovery and vocational attainment Independent living Response to stress Money management Social Meaningful activity, etc Multnomah Community Ability Scale (MCAS)29–31 Adapted community integrations scales (physical and psychological integration)32–34 Recovery Assessment Scale35–37 Vocational Time-Line Follow-Back38 * Quality of life Generic quality of life and health-related quality of life EQ-5D36–38 SF-1228 39 40 SF-6D41 Qoli-2042 Healthcare, social services and justice system use and costs For example, emergency room visits, hospital admissions, primary and specialist care visits, social agency visits, etc. Charges, court appearances, nights in jail or remand, etc Composite checklists of service use and justice system-related events, to be combined with administrative data from several mostly site-specific provincial government sources to which costs will be attached using standard costing methods * Indicates instruments administered every 3 months; all others are every 6 months, except the Housing Quality Scale which is only at 21 months. Most of the primary data are collected via participant interviews using laptop computer-assisted interviewing and entered to a highly secured central database via wireless technology. Several strategies are being used to optimise data quality. First, instruments not previously used in this population were pre-tested in three sites using cognitive interviewing techniques (these findings are reported in a separate, forthcoming publication). Second, interviewers receive ongoing face-to-face and webinar-based training. Third, type and range of data values and mandatory entry are built in to entry fields in the database. Fourth, questions from interviewers are fielded centrally and decision rules made where necessary and circulated to all sites, followed by in-depth review at annual site visits. Fifth, data managers at each site use common data checking routines and findings shared with a multi-site data quality committee. Sixth, the authority to change data elements is restricted to a limited number of personnel and all data changes are logged electronically. Plans to promote continued participation Previous longitudinal studies of homeless individuals have retained 60%–85% of participants over follow-up periods of 18–36 months. Our goal is to retain 80% of participants over 2 years of follow-up, using methods that have been proven to be effective in tracking and retaining homeless and marginalised study participants.43–48 Specifically, efforts have been made to establish trust and rapport with participants at first contact and to explain the importance of their participation in follow-up interviews. At the time of enrolment, participants are asked to provide contact information not only for themselves but also for friends, relatives, service providers and case workers who are most likely to know the participant's future whereabouts and who may be contacted in order to locate them. Participants are also asked to give consent for the social services department that administers benefit payments to disclose their updated contact information to the research team. To facilitate tracking, participants are given a phone number to call-in for a very brief update every month that no interview is scheduled. Every 3 months, in addition to updating contact information, a short interview of 10 min is conducted asking participants about their housing and work situations since the last interview. Participants receive financial compensation for all these updates as well as for interviews. Some sites have also obtained ethics approval to offer more significant compensation for interviews of control group participants after the baseline interview, on the grounds that the opportunity cost of time is higher for TAU than for experimental group participants, who can store food provisions in their own apartment. Participants also have the option to contact a research staff member by phone at these time points to provide updated contact details and other information. They receive the same honorarium as those contacted in-person. Participants are also encouraged to contact a research staff member whenever they move. Finally, with the consent of participants, hospitals, homeless shelters, prisons and treatment centres can be contacted in an effort to locate those who have been lost to follow-up. Sample size Although the aim is to combine participants across sites within each condition, it is recognised that (a) there will most likely be baseline differences across sites, reflecting the different demographic composition of each city; and (b) each site will want to analyse data from their site-specific arm. Consequently, the study is powered so that each site would be able to detect an effect size of 0.5 between TAU and the treatment arms for the major outcome variables. With an α of 0.05 and β of 0.20, sufficient power for analysis will require 63 participants per treatment arm. Given the challenges in following a homeless population over a 2-year follow-up period, an attrition rate of 40% was estimated and recruitment targeted at 100 participants per arm. The exception to this recruitment target is the small pilot study in a rural region adjacent to Moncton, which draws on a matched control design with 25 individuals in each group. The combined sample size of approximately 2500 (which includes additional participants in some of the site-specific arms) will also allow for the use of hierarchical linear modelling (described below) as the primary data analytical strategy. Participants Criteria for inclusion are: Legal adult status (aged 18 or older/19 in British Columbia) Housing status as absolutely homelessness OR precariously housed, according to definitions in appendix 3 The presence of a mental disorder with or without a co-existing substance use disorder, determined by DSM-IV criteria on the Mini International Neuropsychiatric Interview (MINI44) at the time of entry (details in appendix 3). Exclusion criteria are: Currently a client of another ACT or ICM program No legal status as a Canadian citizen, landed immigrant, refugee or refugee claimant Those who are relatively homeless (as defined in appendix 3). Randomisation During the initial eligibility and baseline interviews, participants are administered the Mini International Neuropsychiatric Interview49 and the Multnomah Community Ability Scale,29 50 and are asked questions about service and housing history. If a participant meets eligibility criteria, informed written consent is obtained by the interviewer and he or she is enrolled in the study. Based on an algorithm (see appendix 4) that includes information about diagnosis, social functioning and service use, the participant is assigned to the high need or moderate need condition (this allocation can be modified if relevant information becomes known within a month that changes the level of need, as determined by a central review panel). Randomisation is performed via computer by the central data gathering centre, using adaptive randomisation procedures.51 The decision is immediately sent to the interviewer's laptop at the completion of the session. This approach to randomisation continually changes the probability of being assigned to each group, depending on the number of participants in each. Because each arm of the trial has a maximum of 100 participants, adaptive randomisation better ensures balance between the groups than strict randomisation. Block randomisation was considered infeasible, as it is desirable for participants to know their group assignment immediately after the interview; if block randomisation were used, they would have to wait until enough people were enrolled to complete the block, which could take a few weeks. Interventions Housing First as defined in the Pathways to Housing and Street to Homes approaches creates a recovery-oriented culture that puts participant/tenant choice at the centre of all its considerations with respect to the provision of housing and support services. It operates on the principle that all homeless individuals with mental illness should be offered the opportunity to live in permanent housing of varying types that is otherwise available to people without psychiatric or other disabilities. Assertive in-reach and outreach identifies and engages potential participants avoiding any coercive tactics. Rent supplements are provided so that participants pay 30% or less of their income for housing if in the private market.i Participants may also live in social, supported or alternative housing in which case the rent supplement is not required. Participants must also be provided access to furniture. Treatment and support services are offered by clinicians/providers who are based off-site. Legal rights to tenancy are in place. Whenever possible, leases are in the name of the participant, not the program, to empower participants/tenants in their recovery and autonomy, and assist them in achieving full independence. In essence, it is a housing program with supports delivered without any conditions of housing readiness such as engagement in treatment. However, participants must agree to have 30% of their income paid directly as rent and to be visited in their unit a minimum of once a week by program staff for a length of time that is appropriate to their level of need. (In practice however, participants are not required to agree to automatic withdrawal of their rent contribution from their cheques, and there is some flexibility in the frequency of visits.) The program has control over participant access to housing stock, primarily by facilitating access to rental apartments from community landlords. For housing in the private market (scattered-site), a maximum of 20% of the total units in any one building is dedicated to the program to facilitate community integration. The service array provides support and treatment for mental illness and, where necessary, substance abuse, and differs depending upon the level of individual severity and disability. All services are individualised based upon participant need and preference, including cultural adaptations. Services are provided in the home or community. Service teams work with participants to obtain and maintain housing, promote mental and physical health and reduce the negative impacts of substance use. For those individuals with high needs who have not been able to access traditional housing and services, these services are provided using a modified ACT team as exemplified by Pathways to Housing and described in more detail elsewhere.52 For individuals with moderate needs, services are provided using ICM as exemplified by the Streets to Homes program.ii In this model, consumers are linked primarily to one worker rather than a whole team. Discontinuation of the intervention will occur only in exceptional circumstances when an external review panel determines that there are unmanageable safety risks. Table 2 outlines the key features of the Housing First experimental intervention model and the unique elements of the two service delivery modalities. Table 2 Key features of the experimental intervention Housing First model Recovery oriented culture Based on consumer choice for all services Only requirements: income paid directly as rent; visited at a minimum once a week for pre-determined periods of follow-up supports Rent supplements in private market: participants pay 30% or less of their income or the shelter portion of welfare Treatment and support services voluntary—clinicians/providers based off site Legal rights to tenancy (no head leases with agency rather than individual) No conditions on housing readiness Program facilitates access to housing stock Apartments are independent living settings primarily in scattered sites Services individualised, including cultural adaptations Reduce the negative consequences of substance use Availability of furniture and possibly maintenance services Tenancy not tied to engagement in treatment ACT—high need ICM—moderate need Recovery-oriented ACT team Participant/staff ratio of 10:1 or less and includes a psychiatrist and a nurse Program staff are closely involved in hospital admissions and discharges Teams meet daily and include at least one peer specialist as staff Seven day a week, 24 h crisis coverage Intensive case management for a minimum of 1 year once housed Participant/staff ratio of 20:1 or less Integrated efforts across multiple workers and agencies Workers accompany participants to appointments Centralised assignment and monthly case conferences Seven day a week, 12 h per day coverage ACT, assertive community treatment; ICM, intensive case management. The elements described above define the program model upon with the measurement of fidelity is based, using a new Housing First scale52 developed during the formative evaluation phase of this study. It is based upon the Housing First logic model and draws upon previous fidelity measures of recovery-oriented ACT and supportive housing. It will be completed following annual site visits by a team of external assessors who observe team meetings, review documentation and charts, and interview staff and participants. It is recognised that there may be justifiable deviations from complete fidelity due to tailoring to local conditions. The third arm, site-specific, interventions have unique, but complementary attributes which will be described more fully in reports of the comparisons within each city. The interventions are delivered by 12 existing service agencies who were the successful applicants from each of the five pre-selected cities to a request for proposals that was issued by the Mental Health Commission of Canada. The agencies had to demonstrate their ability to hire, train and supervise staff for the housing and support teams and be financially accountable in the 6-month start-up period. Technical assistance and training on the Housing First intervention is provided on an ongoing basis by a centralised team of experts. Fidelity visits and qualitative interviews are conducted as a part of an extensive process evaluation (Macnaughton E, Goering P, Nelson G. Using Mixed Methods within the At Home/Chez Soi Housing First project: A strategy to evaluate the implementation of a complex population health intervention for people with lived experience of homelessness and mental illness. Submitted, Can J Public Health). Usual care In each city, the housing intervention(s) will be compared to TAU. The intent is to compare a complex new service delivery approach to the ‘real life’ experience that exists in current systems of care. This means that there will be no active intervention introduced by the study for the TAU group. ‘Usual care’ does not mean ‘no care’; it is what people would normally get if this project did not exist. It is recognised that some individuals in the TAU group may over time, through new or existing programs, access some of the same components that make up the housing intervention. It is also likely that the usual care service patterns will differ across cities. This unpredictable mix of service packages is a phenomenon of interest. It is measured through the common protocol and included in the analysis of process and outcomes. Outcomes The key outcome domains for measuring the effectiveness and cost-effectiveness of the intervention are those that have consistently been found to be relevant in studies of housing interventions for individuals with mental health issues. These are listed in table 1. As is acknowledged in the guidelines for evaluations of complex interventions,18 more than one outcome is needed to reflect the multiple effects that are expected. The primary outcomes for assessment of effectiveness are housing stability (as defined by a joint function of number of days housed and number of moves53) and social functioning; secondary outcomes include mental and physical health status, community integration and quality of life. For the economic analyses, system use and costs will be used to calculate the costs of improvements in the primary outcomes of quality of life and days housed. Note that our focus here is on outcomes that will be informed by cross-site or multi-site data. A complementary set of outcomes will be examined through site-specific analyses, with similar analytical methods. Statistical analyses Within each of the high and moderate need groups, participant data will be clustered within site and over time. Missing data are expected due to missed appointments, drop-outs and death. One technique to deal with missing data when the outcome is continuous, is hierarchical linear modelling (HLM; also called random effects regression, latent growth curve analysis and many other names).54 In brief, a regression line is fitted to each person's data, resulting in two parameters: a slope and an intercept, and the analysis focuses on variables that affect these. A minimum of three data points are necessary to fit a straight line, in order to give an estimate of the error of the fit. If there are more than three data points, more complex lines can be fitted (eg, quadratic, cubic), which may better approximate the actual trajectories of change. We do not anticipate differences in the intercept within each site, as randomisation is expected to balance out baseline differences between the groups. However, there may be differences in the intercepts between sites, reflecting differences within the client populations served in each city. We anticipate that the primary factor affecting the slope (ie, the rate of change of the outcome measure) will be group membership (ie, housing intervention or TAU). If there is any significant unexplained variance after baseline differences and group membership have been accounted for, we can look for other factors influencing the slope, such as gender, age, amount of time spent homeless, diagnosis and so forth. Another analytic option that will be considered is generalised estimating equations (GEE),55 which can also accommodate clustered, serially correlated data with missing values. The choice of techniques will be based on the nature of the data and the research question. The analysis plan will combine the TAU groups within need level and across sites. However, it may turn out that the demographic characteristics of participants and available treatments differ so widely from city to city that this will not be possible. In that case, it will be necessary to compare each treatment group to its site-specific TAU group. There will be an interim analysis using 1-year follow-up data, with the final analyses based on the 2-year data. In order to preserve an α level of 0.05, the 1-year analyses will use a nominal critical value of 0.01, and the 2-year analyses will use 0.04. There are no universally accepted methods for dealing with missing data; the only consensus is that sensitivity analyses should be conducted using different methods and comparing the results. In this study, data can be missing at four levels: individual items within instruments, the instruments themselves, specific appointment or data points, and people (due to loss to follow-up or death). We do not expect many individual items to be missing, as most of the instruments will be computer-administered. However, people may refuse to answer a specific question. In such cases, we will either follow the recommendations for prorating (if any) of the scale developer or use multiple imputation. If an instrument or appointment is missed, we will attempt to gather the information at a later visit. Irregular timing of instruments administered multiple times is not a problem for HLM, as it can account for this in deriving the slope for each person. Drop-outs and deaths, though, are a different matter. We cannot assume that these data are missing at random or missing completely at random,56 which is an assumption of most imputation methods. If there are at least three data points for these people, we will analyse them separately to determine if their slopes differ significantly from those of people who remained in the study. If they do not, we will be somewhat more comfortable including them in the analyses; otherwise, they will need to be analysed separately. As previously noted, though, we will analyse the missing data in a number of ways, including HLM, multiple imputation and last observation carried forward. The cost-effectiveness analysis will be conducted using net benefit regression.57 The regression framework allows the implementation of the statistical plans described above. Furthermore, the net benefit regression framework features parametric and non-parametric options to characterise uncertainty in the cost-effectiveness analysis data.58 In addition to incremental net benefit by willingness to pay curves, we will also present our results using cost-effectiveness acceptability curves (CEACs) and scatterplots on the cost-effectiveness plane. Net benefit regression has been used to analyse the cost-effectiveness of various programs for study participants such as those in our study.59 Data access Quantitative data are entered directly into laptops configured specifically for the project and maintained by Health Diary, a contracted service provider who will manage data storage for the study in an off-site centralised server with high levels of physical and network security. No data are stored on the hard drive and after entry hard copies are kept in secure storage at each site. Access to the data is limited to authorised users only, using a multi-level permissions protocol that specifies roles and types of data access using a need-to-know principle. Contractual documents state that the central dataset is the property of and under the control of the Mental Health Commission of Canada to ensure access for all members of the national and local research teams. After the project is complete, investigators will be able to access all or any part of the dataset for additional analyses, contingent upon appropriate Research Ethics Board (REB) approvals. Ethics and dissemination This study has been registered with the International Standard Randomised Control Trial Number Register and assigned ISRCTN42520374. REB approvals have been received from universities or healthcare institutions in each of the five sites (a total of 10 institutions, mostly universities). Additionally, we have REB approval from the university-affiliated teaching hospital in which the coordinating centre is based to conduct secondary analyses and move the data across provincial lines and store them in a central, secure location. A study of this nature raises ethical issues not faced by more traditional interventions involving, for instance, medications or psychotherapy. These include the possibility of harm to the participants, research staff and clinical personnel, due to the nature of the participants' psychiatric problems and their living situations. Analogous to the Data Safety Monitoring Boards which are established in trials of medications, the At Home/Chez Soi Project has set up a Safety and Adverse Events Committee, composed of representatives from the national research group, participants, clinical staff and an ethicist.60 It is charged with receiving and reviewing reports regarding any serious events associated with the project. The results of the multi-site analyses of outcomes at 12 months and 2 years will be reported in a series of core scientific journal papers. Extensive knowledge exchange activities with non-academic audiences will occur throughout the duration of the project. Supplementary Material Author's manuscript Reviewer comments
            • Record: found
            • Abstract: not found
            • Article: not found

            Development and validation of the Working Alliance Inventory.

              • Record: found
              • Abstract: found
              • Article: not found

              Effect of scattered-site housing using rent supplements and intensive case management on housing stability among homeless adults with mental illness: a randomized trial.

              Scattered-site housing with Intensive Case Management (ICM) may be an appropriate and less-costly option for homeless adults with mental illness who do not require the treatment intensity of Assertive Community Treatment.

                Author and article information

                JMIR Res Protoc
                JMIR Res Protoc
                JMIR Research Protocols
                JMIR Publications (Toronto, Canada )
                February 2020
                5 February 2020
                : 9
                : 2
                : e14584
                [1 ] Psychology Department University of Limerick Limerick Ireland
                [2 ] Applied Psychology Research Center Capabilities and Inclusion Instituto Superior de Psicologia Aplicada Instituto Universitário Lisbon Portugal
                [3 ] Centre d'Études et de Recherche sur les Services de Santé et la Qualité de Vie La Timone Medical Campus, School of Medicine Aix-Marseille University Marseille France
                [4 ] Department of Developmental and Social Psychology University of Padova Padova Italy
                [5 ] Impuls - Netherlands Center for Social Care Research Radboud Institute for Health Science Nijmegen Netherlands
                [6 ] Institute of Psychology Opole University Opole Poland
                [7 ] Red de Apoyo a la Integración Sociolaboral Fundacion Madrid Spain
                [8 ] Stockholm Prevents Alcohol and Drug Problems Stockholm Center for Psychiatry Research and Education Karolinska Institute Stockholm Sweden
                [9 ] European Federation of National Organisations Working with the Homeless Brussels Belgium
                [10 ] see Authors' Contributions
                Author notes
                Corresponding Author: Ronni Michelle Greenwood ronni.greenwood@ 123456ul.ie
                Author information
                ©Ronni Michelle Greenwood, Rachel M Manning, Branagh R O'Shaughnessy, Oisin Cross, Maria J Vargas-Moniz, Pascal Auquier, Massimo Santinello, Judith R Wolf, Anna Bokszczanin, Roberto Bernad, Håkan Källmén, Frederik Spinnewijn, José Ornelas, HOME_EU Consortium. Originally published in JMIR Research Protocols (http://www.researchprotocols.org), 05.02.2020.

                This is an open-access article distributed under the terms of the Creative Commons Attribution License ( https://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work, first published in JMIR Research Protocols, is properly cited. The complete bibliographic information, a link to the original publication on http://www.researchprotocols.org, as well as this copyright and license information must be included.

                : 3 May 2019
                : 3 October 2019
                : 16 October 2019
                : 22 October 2019

                homeless services,housing first,recovery,capabilities
                homeless services, housing first, recovery, capabilities


                Comment on this article