In this guide, you will learn how to create & manage product testing campaigns for your community members. This is a way to reward your top members by sending them free products, in exchange for their UGC, reviews, feedbacks and insights.
General Information
The Product Testing channel is a page that displays and lists all existing product testing campaigns:
- Campaigns open for applications or awaiting response to invitations
- Ongoing campaigns that are no longer open for joining
- Completed campaigns
The objectives of product testing are:
- Acquisition: attract the 20% to the community and encourage them to create an account
- Activation: guide new members on the shortest path to their first value-added action for the community
- Retention: bring members back
- Engagement and UGC production: encourage members to produce content reusable by the brand
- Revenue impact: enrich the e-commerce site's product pages with qualitative reviews providing social proof to future buyers
Create a testing campaign
To activate that tab in your back office, please make sure to have a product testing channel set up on your community.
In the Animation tab, click on Product testing, the "Create a new campaign"
Campaign info
- Give your campaign a name
- Then add a description and format your text (we recommend using this to introduce the product that members will be applying to test and any other information that could help them decide if they want to apply)
- Add a banner image to the campaign so customers can visualize the product (size should be 640x200px)
Product
When it comes to choosing a Product, you have 2 options:
- Either you already have a product catalogue implemented on your community → you will be able to select directly a product to test from your catalog by searching for its name
You can only add one product per campaign. If you want to put live a product testing with several products, we recommend using option 2 to manually add your bundle.
- Or you have none, or the product you want to test is a new one → then you have to Add a product manually
Only the image and the name of the product will be visible by your customers. Other fields are simply required from a technical standpoint and should all be filled (e.g. if you don’t have an e-commerce website, and your products don’t have a price, you should put zero).
For the product ID, you can use a fictional one, it won't have any consequences. However, it is important to make sure that this ID does not correspond to an existing product. It is therefore recommended to keep a file to track the history of created IDs.
Once your product has been selected or added manually, it will appear as follow. Click Continue to move to the next steps.
Campaign type
You can now decide which type of campaign you want to create:
Open campaign - you product test will be visible to the entire community, and anyone will be able to apply
By invitation - product test will be visible to members of your choice, for a more exclusive experience.
Focus on campaigns by invitation
- First, use the filters to select the list of members that fit your criteria that will receive an invitation to the test.
- Then, indicate how many testers will be selected for the test in the field ‘Max participants’.
These could be:
Members who have been on the community since [date]
Members that have between [x and y points]
Members that have between x and y followers on Instagram/TikTok
etc.
If you already have in mind a list of members you want to invite in particular, use the Tag column to label them and associate them to the product. Simply hover in the tag column and click ‘Add a tag’ > create a new tag.
Then you can filter by Tag:
Survey
After choosing your campaign type, you will be asked to build the campaign survey (= application form members need to fill in to apply)
Questions configured for the testing profile (accessible in members profile) will be displayed automatically, along with the delivery address.
Only select additional fields that can help you select your testers later on.
In addition to your default questionnaire, you can also build a specific form for your campaign by adding new fileds. This questionnaire will apply for this campaign only. Scroll to the bottom of the list, and click on ‘Add a custom field’.
- Choose if your field is optional or mandatory
- Choose Is Read Only if you simply want to display an information but don’t require any information from the candidates.
- Rank: choose where you want to display the field (1 if you want it to be on top, 10 if you want it to be at the bottom). Fields can’t be reordered after they are created.
- Add as many possibilities as you want for Single Choice or Multiple Choice questions.
The answers to these questions will help you filter and select your testers in the future so make sure to ask the most relevant ones.
Review
This step is optionnal.
Here you can decide what type of contribution you expect from your testers. You should configure Step 5 only if you want to collect UGC for a specific purpose (reuse content in a newsletter, on social, or collect and share with a brand for communities doing retail media).
What is shared at this stage by your testers will not be visible by other members of the community and will only be visible by admins in the back office.
- You can ask them to submit pictures or videos of their product
- Ask them questions by adding custom fields (see previous point) to collect detailed insights
- And ask them to share their thoughts on the product (text)
If you want them to submit any of these, click “Add a review”
It is currently not possible to export data collected here so exploiting it will be manual.
How to configure the review
- Choose the UGC you want to collect: text, images, videos, etc.
- Add Custom fields if you want to ask them specific questions (rate the packaging, the product, overall satisfaction…)
- Configure your advanced settings:
- Allow your testers to customize their review
- Activate the opt-in to ask for their permission to reuse their UGC (mandatory to accept before submitting content)
- Give your pop-up a title in the Header field
- Write a description in the text box: you can put any instructions you’d like your testers to follow when submitting their contribution.
- Order your fields as you want them to appear in the pop-up
You can edit this step of the product test after the campaign is launched if you need to make any adjustments.
Missions
If you want to challenge your users to create content such as UGC within or outside the platform, then click on add Missions. These missions will be visible by testers only, in a dedicated tab of their product test.
Create as many challenges/taks/missions as you want to get the best contributions from your product testers.
All tasks must be completed by the user in order to complete a product test (which can be linked to a main mission to motivate testers to complete all of their tasks).
👉 If you want to collect reviews on your product page, we recommend that you create a mission for this, as you will be able to decline a tester’s submission in case the screenshot of the review does not meet your expectations (whereas you cannot do this in Step 5 which shouldn’t be used for this purpose).
Example of missions created for a specific product test
For more information on missions, please have a read of our full guide below or our dedicated user guide linked here: How to: Create Missions
You will be able to track how many challenges your testers complete in your campaign detail page.
Reminder
It is possible to configure a reminder for each campaign through notification and email.
- Configuration involves selecting the number of days from the date of the first tester selection after which to send the reminder:
- If the selector remains at 0, then no reminder is sent.
- If the selector is set to 12, then the reminder will be sent 12 days after the date of the first tester selection.
- Regardless of the time of day the tester selection is made, the reminder email is sent at 6 a.m.
- The reminder is sent to all testers who have not yet submitted a contribution (i.e., those in status
Testing
). A tester who has already submitted a contribution, even if it has not been validated, will not receive a reminder. - Once the campaign is launched, it is possible to modify this configuration.
- If a reminder is configured and the tester selection has already been made, then the reminder send date is displayed on the reviews page.
Edit your campaign
You can edit your campaign anytime after you’ve created it.
Click on the campaign you want to edit
Then click "Edit campaign"
Select your testers for an open campaign
Once you select testers, the application phase is closed and members are no longer be able to apply. Make sure you have enough applicants before proceeding with your selection (this does not apply for campaigns by invitation only) as you can only select testers once.
Here are some tips to help you select your testers
Select testers from the back office
Use the filters to select your testers. This can be based on…
- Profile: does the product match the tester's profile (type of skin, hair…)?
- Activity: is the member active and engaged in the community (points, status, badges)? This is key as being chosen to test should come as a reward to ensure high amount of reviews collected afterwards.
- Last interaction: make sure to check this filter so you dont chose someone who’s been inactive for months.
- Is user currently testing another product? Make sure you choose members who are not already testing a product to give everyone a chance to test.
Filters are located on the left of the page. Simply choose to adapt the view based on your selection criteria.
When you’re done with your selection, click on "Confirm selection"
Select testers via an imported list
Click Download CSV
and import it on Excel.
Make sure to load data with the following settings:
Do your selection in Excel
Your selection must only contain one column, called “User Id” (respect upper/lower cases + quotation marks) - you should remove all the other columns.
Then save as a .csv file.
On your campaign, click on "Import list" to open the below pop-up, in which you will be able to import your selection:
Once your testers have been selected, they will be informed via an email & in app notification. You can download now their delivery information to send out their product(s) by clicking on Download CSV
in blue
This CSV file contains the following data, in default order, by column:
-
User ID
-
SSO ID
-
Username
-
XP
-
Highest status
-
Tags (separate tags by a comma)
-
Number of testings → obtained by adding the number of Testing V1 campaigns for which the user accepted the invitation, to the number of Testing V2 campaigns for which the user has one of the following statuses:
Testing
TestReviewPending
TestReviewDeclined
-
TestReviewValidated
This data is calculated once a day and is not in real-time.
-
Email
-
Application Date
-
Answers to Custom Fields of the ProductTestingCampain place → 1 column per Custom Field
-
Answers to Custom Fields of the Product Testing place → 1 column per Custom Field
-
Answers to Custom Fields of the Address place → 1 column per Custom Field
-
Answers to Custom Fields of the Private Profile place → 1 column per Custom Field
Once again: after selecting your testers, the campaigns will be closed for any new applications so make sure you have enough candidates before proceeding. However, the campaign will stay visible on the community as an ‘ongoing test’, labeled as ‘Applications closed’.
Track invitations for a private campaign
This tab is only displayed for campaigns of type "By invitation."
This tab allows you to track responses to invitations and possibly manually end the invitation response phase.
Two pieces of data help the admin decide whether to end the invitation response phase or not:
- the number of people invited
- the number of people who have accepted the invitation
The "End invitation phase" button, while the campaign status is in Applying
:
-
upon clicking, a confirmation popup opens
-
once confirmed, a toast message appears, indicating that the modification has been successfully applied
When the maximum number of testers has been reached:
- the campaign automatically changes status to
Testing
- All invited users who have not responded to the invitation switch to status
InvitationMissed
- invited users can no longer respond to the invitation
- the "End invitation phase" button is no longer displayed
Delete or end a campaign
Delete a campaign
Once the campaign is launched, you can indeed delete a campaign. Here's how:
-
Go to the campaign dashboard view.
-
Click on the basket icon of the desired campaign.
-
Confirm deletion.
-
A toast message confirms that the deletion action has been completed successfully.
- Only admins with the
UpdateProductTesting
permission can delete a campaign from the back office. - This action is irreversible: even if it's a soft delete, there is no "recover" function.
- Deleted campaigns no longer appear in the campaign dashboard.
End a campaign
- It allows you to categorize your campaign in the "closed" section on the product testing channel and highlight newer campaigns in this section.
- It enables you to closely track your campaign analytics, such as average campaign duration.
You have 2 options to close a campaign:
- Click on "End campaign": Possible at any time during the campaign (even if you haven't selected testers yet or haven't received all the reviews), you can end your campaign. Neither the candidates nor the testers are notified of this action.
- Validate contributions from all testers: When all testers have submitted their reviews and you have validated them all, the campaign automatically switches to "Closed" status.
👉 Even if a campaign is closed:
- Testers who have not yet submitted their contribution can still do so.
- Admins can still validate reviews that have not yet been validated.
- Testers and admins can continue to use the feed on the campaign detail page.
Delete a tester
Regardless of the status or type of a campaign, it is always possible to delete a tester (after testers selection).
To do this:
-
Go to the Testers page of your campaign.
-
Search for the correct user by their user ID or username using the search bar.
-
Click on the delete icon.
-
Confirm deletion.
The tester will then be permanently removed from the list of testers:
- Targeted missions will no longer appear in their profile.
- There is no automatic message sent; you are free to contact them via email or inbox.
- They will no longer have access to the detailed campaign page.
- Their activity on the discussion feed will be deleted: they will no longer be mentioned or receive notifications related to the feed.
This also means that:
- The tester will no longer appear in the testers or reviews listings.
- Contributions submitted by this user will no longer be counted in the mission completion tracking table.
Track your testers activity
Missions
If you have configured one or more missions with screenshot validation (requiring your approval to be completed), you can validate the screenshots submitted by testers directly from the campaign tracking.
To do this, go to the Mission validation tab of your campaign.
This is the same component as the other screenshot missions, so you will find the same functionality and UX/UI.
This view is filtered to display only the targeted missions of the campaign:
- If you click Accept, the tester will be notified on the community & earn points
- If you click Decline, the tester will be notified and will have possibility to submit a new screenshot on the corresponding mission.
Last step (Reviews)
The Last Step tab serves several purposes:
- Tracking the completion rate of each mission, thanks to the integration of a Power BI board
- Tracking each user's completion of required tasks
- Verifying the content of the review/contribution (configured in Step 5)
- Validating the completion of the test for each tester
The Power BI board displays the list of all targeted missions in the campaign, and for each of these missions, the completion rate, i.e., the percentage of testers who have completed the mission.
👉These data will guide you in deciding whether it is time to end the campaign or to relaunch the testers.
The tracking of test completion is divided into 2 tabs:
- Ongoing
- Completed
Ongoing Tab
The Ongoing tab aims to validate the test completion of different testers:
- It lists all testers in Pending and Testing status.
- Testers in Pending status are displayed first by default because they have clicked on the "last step" to indicate that they have submitted all required contributions to the test.
- Testers in Testing status are also displayed to cover cases where clients consider certain missions optional or where testers forget to complete the "last step."
- This tab displays the following columns:
-
Username: Profile picture + username
-
Status: Pending (the tester clicked on last step to indicate they have submitted all requested contributions) or Testing (the tester has not finished completing the test)
-
Review: If you have configured a review metaposter, a Review column will show whether the tester has submitted their review. The "check review" CTA indicates it has been submitted.
-
One column per targeted mission: These columns allow you to identify if the tester has completed the mission or not.
→ Horizontal scrolling allows you to access all columns.
-
A "..." button allows you to chat with the tester from admin v2 or view their community profile.
-
A "validate full test" button allows you to indicate that the tester has completed their test → this will unlock related unlockables and change the tester's status to Validated.
-
Completed Tab
The Completed tab allows you to find details of contributions submitted by testers whose tests have already been validated.
Viewing Review Details
To view the details of a review, simply click on the "Check review" CTA: the popup with the review details will then open.
Validating a Test
Why validate a test?
- If an unlockable is linked to completing a product testing, clicking on "Validate full test" will allow the user to unlock this unlockable → complete a mission, earn points, achieve a status, obtain a badge...
- If all testers' tests are validated, the campaign is automatically closed.
- In the case of a configured automatic reminder to get reviews from those who are late, validating a tester's test prevents them from being reminded.
To validate the test completion of a tester, simply click on "Validate full test."
👉When you validate a tester's test, they receive an email and a notification indicating that their test is completed and validated.
Emails & notifications
-
The wording of notifications is editable in the back office: Settings > Wordings > Platform > product_testing_campaign
-
Automated emails are managed from the admin V2 Settings > Look & feel > Emails (which should have been configured during the implementation phase of the project)
- You can enable or disable them using the toggle switch.
- You can send a test email to admins.
- If you are not familiar with UI modifications in emails, you can consult with Francesca to see what can be done.
Invitation to an Exclusive Campaign
When the admin starts a campaign in "by invitation only" mode, all invited users automatically receive a notification and an email inviting them to respond quickly to the invitation to participate.
Notification
- Triggered by: The admin clicks on "Launch campaign" at the end of the campaign configuration.
- Sent to: All users selected as invitees.
- Clicking redirects to: The campaign detail page.
- Triggered by: The admin clicks on "Launch campaign" at the end of the campaign configuration.
- Sent to: All users selected as invitees.
- Clicking redirects to: The campaign detail page.
Application accepted
When the admin selects and approves a candidate as a tester, the user automatically receives a notification and an email indicating that they have been selected and will soon receive the product to test.
- Email triggered by: The admin clicks on "Confirm" for tester selection.
- Sent to: All users selected as testers.
- CTA redirection page: campaign page.
Custom Targeted Email
It's possible to send targeted and fully customized emails from a test campaign.
Here's how:
-
Click on the "Send out email" button in the campaign header.
-
Select recipients based on the desired status:
- Invitation pending
- Application pending/rejected
- Testing
- Test review pending
- Test review validated
→ As a reminder, here are the different existing statuses
-
Fill in the subject of your email.
-
Complete the body of your email.
-
Confirm sending.
For your information, the date and time of the last email sent are displayed (in UTC) at the top of the recipient selection, to prevent multiple emails from being sent in error.
Similar to the Community Emails feature:
-
You can preview the desktop and mobile rendering.
-
You can test the email before sending it.
-
Only users with the permission
SendEmail
can send these emails. -
These emails are displayed in the list of sent emails.
FAQs
Click on your campaign to open the details, then Download CSV. Make sure you have selected your testers beforehand.
No, you can only add one product per campaign. If you want to put live a product testing with several products, we recommend using option 2 to manually add your bundle (make sure the image you upload is featuring all the products). Also make sure that your campaign’s description is introducing all the products.
If you select a member to test a product and that person ends up not leaving a review despite multiple flags/messages, use the Tag feature from the User table (Stats Users). You can call the Tag ‘Bad tester’ or ‘Do not select’. You will then see that information if that person applies for a new test, so you don’t select her for another chance to test.
Please make sure that:
- Your file only contains 1 column called “User Id“ (quotation marks included)
- That there is no empty column or empty line
- You have saved your file as a csv.
Contact your CSM if you’ve met all these criteria and are still experiencing the issue.
When creating your product test, we recommend to add a dedicated Custom Field on the Step 4 called Survey. Click ‘Add a custom field’ and configure your question directly here.
- If you only have few shades available, you can go for a Single choice question and list your shades in the Possibilities.
- If you have a lot of shades, and don’t have the time to list them all, you can create a text field. Please keep in mind that this option could be less reliable as candidates could enter typos.
Make sure that you also link your Shade finder somewhere in your campaign’s description so that candidates can easily access it. You won’t be able to link it in your dedicated custom field.
No, all missions configured in a product test are mandatory to complete in order for a test to be finalized (if you have an all-time mission giving points for completing all the tasks in a product test, members will only be able to win points if they do all their testers’ missions).
If you don’t have an all-time mission giving points for completing all the tasks in a product test, testers can still do the testers’ tasks of their choice, and you can validate their test manually from the back office.
It’s currently not possible to export contributions, but you can copy/paste verbatims or save images submitted. It’s in our backlog to make it possible in the future.