Disclaimer:
Please be aware that the content herein has not been peer reviewed. It consists of personal reflections, insights, and learnings of the contributor(s). It may not be exhaustive, nor does it aim to be authoritative knowledge.
Overview
Prepared by (Name of the experimenter)
AccLabPY
On date (Day/Month/Year)
31/10/2022
Current status of experimental activity
Completed
What portfolio does this activity correspond to? If any
Formalization of employment
What is the frontier challenge does this activity responds to?
This activity is framed within the frontier challenge "Employment formalization", since the learning cycle aims to identify strategies to motivate the enrollment of domestic workers in the social security system, reducing the investment of time and effort required by employers to register their domestic workers in the social security in Paraguay (IPS).
What is the learning question(from your action learning plan) is this activity related to?
The original learning question of our action learning plan is: how can we increase access to social security and improve the economic and physical security of employment in Paraguay's informal economy, particularly for women and in the recycling, construction, domestic work, and apparel industries?
Please categorize the type that best identifies this experimental activity:
Quasi Experimental (Analytical, observations, etc), Fully Randomised (RCTs, etc.)
Which sector are you partnering with for this activity? Please select all that apply
United Nations agency, Public Sector, Private Sector, Civil Society/ NGOs
Please list the names of partners mentioned in the previous question:
Public sector: Ministerio de Trabajo, Empleo y Seguridad Social (Ministry of Labor), International Labour Organization (ILO).
Private sector/civil society: Social clubs (Club Centenario and Club Internacional de Tenis) Cooperatives (Cooperativa COOMECIPAR)
Design
What is the specific learning intent of the activity?
Assess how a personalized advice service offered by the Ministry of Labor and the awareness strategy on domestic work directed to employers, can influence the increase in the registration of domestic workers in social security.
What is your hypothesis? IF... THEN....
The hypothesis that supports the intervention is that active advisory service to employers on current regulations, requirements, obligations, rights, benefits, and registration procedures for domestic workers to social security increases the formalization of employment. The experimental intervention was designed to influence he degree of knowledge that employers have about labor regulations and formalization procedures, through an active and personalized advsory service that, together with an awareness strategy to revalue domestic work, allows employers to prioritize formal social security strategies and encourage their proactivity to increase the registration of their domestic workers to social security.
Does the activity use a control group for comparison?
Yes, a different group entirely
How is the intervention assigned to different groups in your experiment?
Random assignment
Describe which actions will you take to test your hypothesis:
Design an advisory telephone-based service for employers to learn more and understand better the procedures to register their domestic workers into the Social Security System of Paraguay, to formalize their employment. Subscribe employers to the service for a 1 month period. Observe their user experience with the service, collect administrative records to evaluate how advanced in formalizing their employees they are, and survey them on their knowledge and perceptions of formalization at the end of the process.
What is the unit of analysis of this experimental activity?
Employers and potential employers of paid domestic workers
Please describe the data collection technique proposed
We analyze the knowledge and perceptions about the social security of employers interested in accessing information and advice on the procedures for registering their domestic workers for social security. The participants voluntarily agreed to participate in the intervention through a registration form that included basic variables such as: contact information (cell phone and e-mail), if the interested person had a history of hiring domestic workers and questions about their experience with the registration procedures in the social security system in Paraguay (IPS). The registration form was distributed within the following organizations: Cooperativa COOMECIPAR, Club Centenario and Club Internacional de Tenis (CIT). To achieve coordination with these civil society organizations, collaboration and cooperation agreements were signed during the intervention period.
We use simple random sampling (randomized control trial) to randomly defined two subgroups of the target population to determine the control (Group 1) and treatment groups (Group 2). The random selection allowed us to establish two subgroups of balanced participants with respect to the main sociodemographic characteristics collected with the registration form. The resulting randomization assigned a total of 75 participants to the control group and 76 participants to the treatment group. To observe the effects of the intervention, we designed a survey to measure the knowledge and perceptions about the social security and labor rights of domestic workers that employers have. This survey also captures if the registration of the domestic workers to the IPS was effective. To collect all this information, the survey was divided into three sections. The first section included questions to measure whether the intervention made it possible to start the registration procedures for domestic workers in the IPS, the level of progress in the registration procedures, and/or the reasons that have prevented the progress of registration in the IPS. Secondly, we propose questions to measure whether the intervention generated changes in the degree of knowledge about labor rights of domestic workers and registration procedures for IPS in the employers. Finally, the third section was designed to observe changes generated by the intervention in the perception that employers have regarding the work performed by paid domestic workers. The instrument was applied to the 151 participants registered for the intervention (75 in the control group and 76 in the treatment group).
What is the timeline of the experimental activity? (Months/Days)
1 month
What is the estimated sample size?
100-999
What is the total estimated monetary resources needed for this experiment?
Between 1,000 and 9,999 USD
Quality Check
This activity is relevant to a CPD outcome, The hypothesis is clearly stated, This activity offers strong collaboration oportunities, This activity offers a high potential for scaling
Please upload any supporting images or visuals for this experiment.
Please upload any supporting links
What are the estimated non- monetary resources required for this experiment? (time allocation from team, external resources, etc) If any.
Approximately 20% of the time of our Head of Experimentation, 20% of the time of our Head of Solutions Mapping, 20% of the time of our Head of Exploration, plus 100% [CM1] of the time of three people hired for the learning cycle on formalization, was dedicated to the design, management, analysis, reporting, and monitoring of results, throughout the duration of the intervention. Moreover, the lab also counted with the help of a Research Associate, who devoted over 50% of her time to both implementation and analysis of the experiment. And we also hired a consultant to articulate our relationship with the private sector and civil society allies, with the goal of subscribing more employers into the prototyped advising service.
Results
Was the original hypothesis (If.. then) proven or disproven?
To measure the impact of the intervention, we created indices according to the questions included in the evaluation survey based on three central aspects: 1) the registration process, 2) the knowledge about regulations and rights related to paid domestic work, and 3) the perceptions that employers have on paid domestic work.
These indices are used to verify whether there are significant differences in the average responses provided by the participants in the control and treatment groups. To measure the effects generated by the intervention, we estimated the differences between the control group and the treatment group using the Ordinary Least Squares (OLS) estimator. We found no significant effects on the degree of formalization of domestic workers as a result of the intervention, since the differences observed in the average values between the control and treatment groups are not statistically significant.
Both the control and treatment group participants received all the necessary information about the regulations of paid domestic work and the IPS registration procedures for domestic workers. The difference between the group control is that treatment group participants were also contacted individually, and they were constantly supported to resolve any doubts that might arise in the registration procedures for three weeks.
Do you have observations about the methodology chosen for the experiment? What would you change?
The participants of the intervention voluntarily agreed to participate, hence, those who registered, self-selected to participate in the intervention due to a previous interest in obtaining information about the registration procedures and the potential interest in registering their domestic workers in IPS. Therefore, the interpretation of the results obtained must consider that they are employers who have previous motivations to find out about regulations and procedures for registering paid domestic work. As a consequence, the results of the intervention represent the behavior of a group of employers who, due to their socioeconomic profile, are characterized by having a certain potential for the registration of domestic workers in IPS. Thus, the results cannot be extrapolated to other population groups that present different characteristics from those identified in this study.
One aspect that could be improved in the intervention is to expand the focus to other types of employers, with other socioeconomic profiles, that is, to have a more comprehensive sample to be able to draw more general conclusions that do not adjust only to a particular group of the population.
From design to results, how long did this activity take? (Time in months)
6 months
What were the actual monetary resources invested in this activity? (Amount in USD)
For evaluation purposes only:
1. Protocol of the advisory service ~ $5000
2. Advisers who provided the service ~ $3000
3. Intervention Assistant ~ $2500
4. Comms ~ $3000
5. Other resources: time invested by AccLab Members (average or 2h-4h/week over the full period of the pilot), full-time commitment of three people hired for the formalization project, time spent by officials from the Ministry of Labor for the intervention.
Does this activity have a follow up or a next stage? Please explain
Because of the positive assessment of the service by employers, and despite it not leading straight to an increase in Social Security registrations, we are adapting and improving the advising intervention to transfer it into a different sector, within the framework of a Poverty Innovation Funding Window (PIFW) follow up project to our Formalization Laboratory.
Is this experiment planned to scale? How? With whom?
In the new iteration, under the PIFW project, it will be based on a program called “MiPyme Cumple”, which offers a wide range of advising support to SMEs on topics related to formalization. This will be combined with reflection-oriented workshops on labor rights and productivity advise, all oriented towards SMEs that have informal employment.
Please add any supporting links that describe the planning, implementation, results of learning of this activity? For example a tweet, a blog, or a report.
Considering the outcomes of this experimental activity, which of the following best describe what happened after? (Please select all that apply)
This experiment led to partnerships, This experiment led to resource mobilization
Learning
What do you know now about the action plan learning question that you did not know before? What were your main learnings during this experiment?
We find that there is a positive assessment of the advisory service, especially on the provision of the paperwork documentation needed to register a domestic worker in IPS. We also find that the participants have a low level of knowledge on the specific regulations on domestic work.
With this intervention, we also identify that the bureaucratic barriers limited the intention of employer to formalize their domestic workers, suggesting that centralizing and improving the information regarding IPS registration could help to avoid the information loss. Similarly, we learnt that digitalization and virtuality in the registration processes should be a next step to encourage the entry of domestic workers to the social security system.
What were the main obstacles and challenges you encountered during this activity?
During the implementation and evaluation of the experimentation, we face external factors that negatively affected the process:
a) the experimentation took place at the end of the year, so it was affected by the lack of time of the participants and the difficulty in capturing their interest and attention.
b) the short application time of the advisory service did not allow a time for the assimilation of the information that would lead to action.
c) climatic factors such as storms that left several participants without WhatsApp connection for one or two days.
Who at UNDP might benefit from the results of this experimental activity? Why?
The Inclusive Development Portfolio of our CO also focuses on some activities related to employment formalization and our findings could help to shape and design new projects and activities oriented to reduce the barriers to formalization in some industries such as construction, domestic work, among others.
Who outside UNDP might benefit from the results of this experiment? and why?
1. The Ministry of Labor can benefit from the results obtained, since the findings show that offering an advisory service to employers, can change the perception that they have about social security for domestic workers.
2. Employers who receive the advisory service could improve their knowledge about social security and labor rights for domestic workers.
Domestic workers who provide their services to employers that receive the advisory service.
Did this experiment require iterations? If so, how many and what did you change/adjust along the way? and why?
No, this experiment did not require iterations.
What advice would you give someone wanting to replicate this experimental activity?
Choose another period for the intervention: due to logistical and administrative issues, our intervention took place in December 2021, a difficult month to capture the time and attention of the participants.
Include more employer profiles: this will allow the analysis to consider a wider variety of profiles that hire domestic workers and cover more dimensions of the reality of informality in this sector.
Can this experiment be replicated in another thematic area or other SDGs? If yes, what would need to be considered, if no, why not?
Yes, the experiment can be used in any other sector with a high rate of informality. The idea of offering an active advisory service to employers who have decision-making power may be crucial to increase the chances of registering workers in the social security.
How much the "sense" and "explore" phases of the learning cycle influenced/shaped this experiment? In hindsight, what would you have done differently with your fellow Solution Mapper and Explorer?
Both sensing and exploration activities influenced greatly the design of the experiment, the hypotheses we decided to test, the places and people we engaged, and the things we needed to observe as the experiment unfolded. The activities designed as a part of the mapping and exploration phases, make it possible to made it possible to know in depth the needs of the actors involved, so that the experimentation was fully based on the findings of these phases.
What surprised you?
Considering the limitations in terms of time and resources, it was surprising that we finally got 151 people to subscribe to the pilot service. Our goal was higher, but our expectation was lower, and therefore, getting this number of participants was surprising for us.
Comments
Log in to add a comment or reply.