How to: Set up and manage a product testing campaign

In this guide, you will learn how to create & manage product testing campaigns for your community members. This is a way to reward your top members by sending them free products, in exchange for their UGC, reviews, feedbacks and insights.

General Information

The Product Testing channel is a page that displays and lists all existing product testing campaigns:

  • Campaigns open for applications or awaiting response to invitations
  • Ongoing campaigns that are no longer open for joining
  • Completed campaigns

The objectives of product testing are:

  • Acquisition: attract the 20% to the community and encourage them to create an account
  • Activation: guide new members on the shortest path to their first value-added action for the community
  • Retention: bring members back
  • Engagement and UGC production: encourage members to produce content reusable by the brand
  • Revenue impact: enrich the e-commerce site's product pages with qualitative reviews providing social proof to future buyers

 

43 Capture d’écran 2024-07-22 083450.png     442 Capture d’écran 2024-07-22 083750.png

 

Create a testing campaign

To activate that tab in your back office, please make sure to have a product testing channel set up on your community.

 

46 Capture d’écran 2024-07-22 084857.png

 

In the Animation tab, click on Product testing, the "Create a new campaign"

 

47 Capture d’écran 2024-07-22 085153.png

 

Campaign info

  1. Give your campaign a name
  2. Then add a description and format your text (we recommend using this to introduce the product that members will be applying to test and any other information that could help them decide if they want to apply)
  3. Add a banner image to the campaign so customers can visualize the product (size should be 640x200px)

 

11 prod.png

Product

When it comes to choosing a Product, you have 2 options:

  • Either you already have a product catalogue implemented on your community → you will be able to select directly a product to test from your catalog by searching for its name 

You can only add one product per campaign. If you want to put live a product testing with several products, we recommend using option 2 to manually add your bundle.

  • Or you have none, or the product you want to test is a new one → then you have to Add a product manually 

option 2 Capture d’écran 2024-07-27 181807.png

Only the image and the name of the product will be visible by your customers. Other fields are simply required from a technical standpoint and should all be filled (e.g. if you don’t have an e-commerce website, and your products don’t have a price, you should put zero).

For the product ID, you can use a fictional one, it won't have any consequences. However, it is important to make sure that this ID does not correspond to an existing product. It is therefore recommended to keep a file to track the history of created IDs.

Once your product has been selected or added manually, it will appear as follow. Click Continue to move to the next steps.

 

option 22.png

Campaign type

You can now decide which type of campaign you want to create:

Open campaign - you product test will be visible to the entire community, and anyone will be able to apply

By invitation - product test will be visible to members of your choice, for a more exclusive experience.

 

option 3.png

 

Focus on campaigns by invitation

  • First, use the filters to select the list of members that fit your criteria that will receive an invitation to the test.
  • Then, indicate how many testers will be selected for the test in the field ‘Max participants’.
    These could be: 
    Members who have been on the community since [date]
    Members that have between [x and y points]
    Members that have between x and y followers on Instagram/TikTok
    etc.

If you already have in mind a list of members you want to invite in particular, use the Tag column to label them and associate them to the product. Simply hover in the tag column and click ‘Add a tag’ > create a new tag.

 

                                 option 23.png

Then you can filter by Tag:

tag.png

Survey

After choosing your campaign type, you will be asked to build the campaign survey (= application form members need to fill in to apply)

Questions configured for the testing profile (accessible in members profile) will be displayed automatically, along with the delivery address.

Only select additional fields that can help you select your testers later on.

 

                     survey.png

 

In addition to your default questionnaire, you can also build a specific form for your campaign by adding new fileds. This questionnaire will apply for this campaign only. Scroll to the bottom of the list, and click on ‘Add a custom field’.

 

                              survey.png

 

  • Choose if your field is optional or mandatory
  • Choose Is Read Only if you simply want to display an information but don’t require any information from the candidates.
  • Rank: choose where you want to display the field (1 if you want it to be on top, 10 if you want it to be at the bottom). Fields can’t be reordered after they are created.
  • Add as many possibilities as you want for Single Choice or Multiple Choice questions.

The answers to these questions will help you filter and select your testers in the future so make sure to ask the most relevant ones.

Review

This step is optionnal.

Here you can decide what type of contribution you expect from your testers. You should configure Step 5 only if you want to collect UGC for a specific purpose (reuse content in a newsletter, on social, or collect and share with a brand for communities doing retail media).

What is shared at this stage by your testers will not be visible by other members of the community and will only be visible by admins in the back office.

  • You can ask them to submit pictures or videos of their product
  • Ask them questions by adding custom fields (see previous point) to collect detailed insights
  • And ask them to share their thoughts on the product (text)

If you want them to submit any of these, click “Add a review”

It is currently not possible to export data collected here so exploiting it will be manual.

 

How to configure the review

 

                                   review.png

  • Choose the UGC you want to collect: text, images, videos, etc.
  • Add Custom fields if you want to ask them specific questions (rate the packaging, the product, overall satisfaction…)
  • Configure your advanced settings:
    • Allow your testers to customize their review
    • Activate the opt-in to ask for their permission to reuse their UGC (mandatory to accept before submitting content)

content.png

  • Give your pop-up a title in the Header field
  • Write a description in the text box: you can put any instructions you’d like your testers to follow when submitting their contribution.
  • Order your fields as you want them to appear in the pop-up

You can edit this step of the product test after the campaign is launched if you need to make any adjustments.

Missions

If you want to challenge your users to create content such as UGC within or outside the platform, then click on add Missions. These missions will be visible by testers only, in a dedicated tab of their product test.

Create as many challenges/taks/missions as you want to get the best contributions from your product testers.

All tasks must be completed by the user in order to complete a product test (which can be linked to a main mission to motivate testers to complete all of their tasks).

👉 If you want to collect reviews on your product page, we recommend that you create a mission for this, as you will be able to decline a tester’s submission in case the screenshot of the review does not meet your expectations (whereas you cannot do this in Step 5 which shouldn’t be used for this purpose).

 

option 4.png

 

Example of missions created for a specific product test

For more information on missions, please have a read of our full guide below or our dedicated user guide linked here: How to: Create Missions

You will be able to track how many challenges your testers complete in your campaign detail page.

Reminder

It is possible to configure a reminder for each campaign through notification and email.

  • Configuration involves selecting the number of days from the date of the first tester selection after which to send the reminder:
    • If the selector remains at 0, then no reminder is sent.
    • If the selector is set to 12, then the reminder will be sent 12 days after the date of the first tester selection.
    • Regardless of the time of day the tester selection is made, the reminder email is sent at 6 a.m.
  • The reminder is sent to all testers who have not yet submitted a contribution (i.e., those in status Testing). A tester who has already submitted a contribution, even if it has not been validated, will not receive a reminder.
  • Once the campaign is launched, it is possible to modify this configuration.
  • If a reminder is configured and the tester selection has already been made, then the reminder send date is displayed on the reviews page.

Edit your campaign

You can edit your campaign anytime after you’ve created it.

Click on the campaign you want to edit

option 5.png

 

Then click "Edit campaign"

 

option 6.png

 

Select your testers for an open campaign

Once you select testers, the application phase is closed and members are no longer be able to apply. Make sure you have enough applicants before proceeding with your selection (this does not apply for campaigns by invitation only) as you can only select testers once.

Here are some tips to help you select your testers

Select testers from the back office

Use the filters to select your testers. This can be based on…

  • Profile: does the product match the tester's profile (type of skin, hair…)?
  • Activity: is the member active and engaged in the community (points, status, badges)? This is key as being chosen to test should come as a reward to ensure high amount of reviews collected afterwards.
  • Last interaction: make sure to check this filter so you dont chose someone who’s been inactive for months.
  • Is user currently testing another product? Make sure you choose members who are not already testing a product to give everyone a chance to test.

Filters are located on the left of the page. Simply choose to adapt the view based on your selection criteria.

 

option 7.png

 

When you’re done with your selection, click on "Confirm selection"

option 8.png

Select testers via an imported list

Click Download CSV and import it on Excel.

 

                    option 9.png

 

Make sure to load data with the following settings:

option 10.png

 

Do your selection in Excel  

Your selection must only contain one column, called “User Id” (respect upper/lower cases + quotation marks) - you should remove all the other columns.

                                                                                12 prod.png

 

Then save as a .csv file.

On your campaign, click on "Import list" to open the below pop-up, in which you will be able to import your selection:

14.png

15 Capture d’écran 2024-07-28 150443.png

16.png

Once your testers have been selected, they will be informed via an email & in app notification. You can download now their delivery information to send out their product(s) by clicking on Download CSV in blue

20.png

This CSV file contains the following data, in default order, by column:

  1. User ID

  2. SSO ID

  3. Username

  4. XP

  5. Highest status

  6. Tags (separate tags by a comma)

  7. Number of testings → obtained by adding the number of Testing V1 campaigns for which the user accepted the invitation, to the number of Testing V2 campaigns for which the user has one of the following statuses:

    • Testing
    • TestReviewPending
    • TestReviewDeclined
    • TestReviewValidated

    This data is calculated once a day and is not in real-time.

  8. Email

  9. Application Date

  10. Answers to Custom Fields of the ProductTestingCampain place → 1 column per Custom Field

  11. Answers to Custom Fields of the Product Testing place → 1 column per Custom Field

  12. Answers to Custom Fields of the Address place → 1 column per Custom Field

  13. Answers to Custom Fields of the Private Profile place → 1 column per Custom Field

Once again: after selecting your testers, the campaigns will be closed for any new applications so make sure you have enough candidates before proceeding. However, the campaign will stay visible on the community as an ‘ongoing test’, labeled as ‘Applications closed’.

 

Track invitations for a private campaign

This tab is only displayed for campaigns of type "By invitation."

     21.png

 

This tab allows you to track responses to invitations and possibly manually end the invitation response phase.

Two pieces of data help the admin decide whether to end the invitation response phase or not:

  • the number of people invited
  • the number of people who have accepted the invitation

The "End invitation phase" button, while the campaign status is in Applying:

  • upon clicking, a confirmation popup opens

         22.png

  • once confirmed, a toast message appears, indicating that the modification has been successfully applied

When the maximum number of testers has been reached:

  • the campaign automatically changes status to Testing
  • All invited users who have not responded to the invitation switch to status InvitationMissed
  • invited users can no longer respond to the invitation
  • the "End invitation phase" button is no longer displayed

Delete or end a campaign

Delete a campaign

Once the campaign is launched, you can indeed delete a campaign. Here's how:

  1. Go to the campaign dashboard view.23.png

  2. Click on the basket icon of the desired campaign.

    24.png
  3. Confirm deletion.

    25.png
  4. A toast message confirms that the deletion action has been completed successfully.

  • Only admins with the UpdateProductTesting permission can delete a campaign from the back office.
  • This action is irreversible: even if it's a soft delete, there is no "recover" function.
  • Deleted campaigns no longer appear in the campaign dashboard.

End a campaign

  • It allows you to categorize your campaign in the "closed" section on the product testing channel and highlight newer campaigns in this section.
  • It enables you to closely track your campaign analytics, such as average campaign duration.

You have 2 options to close a campaign:

  1. Click on "End campaign": Possible at any time during the campaign (even if you haven't selected testers yet or haven't received all the reviews), you can end your campaign. Neither the candidates nor the testers are notified of this action.
  2. Validate contributions from all testers: When all testers have submitted their reviews and you have validated them all, the campaign automatically switches to "Closed" status.

👉 Even if a campaign is closed:

  • Testers who have not yet submitted their contribution can still do so.
  • Admins can still validate reviews that have not yet been validated.
  • Testers and admins can continue to use the feed on the campaign detail page.

Delete a tester

Regardless of the status or type of a campaign, it is always possible to delete a tester (after testers selection).

To do this:

  1. Go to the Testers page of your campaign.

           26.png
  2. Search for the correct user by their user ID or username using the search bar.

  3. Click on the delete icon.

  4. Confirm deletion.

                     27.png

The tester will then be permanently removed from the list of testers:

  • Targeted missions will no longer appear in their profile.
  • There is no automatic message sent; you are free to contact them via email or inbox.
  • They will no longer have access to the detailed campaign page.
  • Their activity on the discussion feed will be deleted: they will no longer be mentioned or receive notifications related to the feed.

This also means that:

  • The tester will no longer appear in the testers or reviews listings.
  • Contributions submitted by this user will no longer be counted in the mission completion tracking table.

Track your testers activity 

Missions

If you have configured one or more missions with screenshot validation (requiring your approval to be completed), you can validate the screenshots submitted by testers directly from the campaign tracking.

To do this, go to the Mission validation tab of your campaign.

                         28.png

This is the same component as the other screenshot missions, so you will find the same functionality and UX/UI.

This view is filtered to display only the targeted missions of the campaign:

  • If you click Accept, the tester will be notified on the community & earn points
  • If you click Decline, the tester will be notified and will have possibility to submit a new screenshot on the corresponding mission.

Last step (Reviews)

The Last Step tab serves several purposes:

  • Tracking the completion rate of each mission, thanks to the integration of a Power BI board
  • Tracking each user's completion of required tasks
  • Verifying the content of the review/contribution (configured in Step 5)
  • Validating the completion of the test for each tester

The Power BI board displays the list of all targeted missions in the campaign, and for each of these missions, the completion rate, i.e., the percentage of testers who have completed the mission.

👉These data will guide you in deciding whether it is time to end the campaign or to relaunch the testers.

The tracking of test completion is divided into 2 tabs:

  • Ongoing
  • Completed

Ongoing Tab

           29.png

The Ongoing tab aims to validate the test completion of different testers:

  • It lists all testers in Pending and Testing status.
  • Testers in Pending status are displayed first by default because they have clicked on the "last step" to indicate that they have submitted all required contributions to the test.
  • Testers in Testing status are also displayed to cover cases where clients consider certain missions optional or where testers forget to complete the "last step."
  • This tab displays the following columns:
    • Username: Profile picture + username

    • Status: Pending (the tester clicked on last step to indicate they have submitted all requested contributions) or Testing (the tester has not finished completing the test)

    • Review: If you have configured a review metaposter, a Review column will show whether the tester has submitted their review. The "check review" CTA indicates it has been submitted.

    • One column per targeted mission: These columns allow you to identify if the tester has completed the mission or not.

      → Horizontal scrolling allows you to access all columns.

    • A "..." button allows you to chat with the tester from admin v2 or view their community profile.

                                                     30.png
    • A "validate full test" button allows you to indicate that the tester has completed their test → this will unlock related unlockables and change the tester's status to Validated.

Completed Tab

The Completed tab allows you to find details of contributions submitted by testers whose tests have already been validated.

                                      31.png

Viewing Review Details

32.png

To view the details of a review, simply click on the "Check review" CTA: the popup with the review details will then open.

33.png

Validating a Test

Why validate a test?

  • If an unlockable is linked to completing a product testing, clicking on "Validate full test" will allow the user to unlock this unlockable → complete a mission, earn points, achieve a status, obtain a badge...
  • If all testers' tests are validated, the campaign is automatically closed.
  • In the case of a configured automatic reminder to get reviews from those who are late, validating a tester's test prevents them from being reminded.

To validate the test completion of a tester, simply click on "Validate full test."

34.png

👉When you validate a tester's test, they receive an email and a notification indicating that their test is completed and validated.

Emails & notifications

  • The wording of notifications is editable in the back office: Settings > Wordings > Platform > product_testing_campaign

35.png

  • Automated emails are managed from the admin V2 Settings > Look & feel > Emails (which should have been configured during the implementation phase of the project)

36.png

  • You can enable or disable them using the toggle switch.
  • You can send a test email to admins.
  • If you are not familiar with UI modifications in emails, you can consult with Francesca to see what can be done.

Invitation to an Exclusive Campaign

When the admin starts a campaign in "by invitation only" mode, all invited users automatically receive a notification and an email inviting them to respond quickly to the invitation to participate.

Notification

  • Triggered by: The admin clicks on "Launch campaign" at the end of the campaign configuration.
  • Sent to: All users selected as invitees.
  • Clicking redirects to: The campaign detail page.

37.png

Email

  • Triggered by: The admin clicks on "Launch campaign" at the end of the campaign configuration.
  • Sent to: All users selected as invitees.
  • Clicking redirects to: The campaign detail page.

38.png

 

Application accepted

When the admin selects and approves a candidate as a tester, the user automatically receives a notification and an email indicating that they have been selected and will soon receive the product to test.

  • Email triggered by: The admin clicks on "Confirm" for tester selection.
  • Sent to: All users selected as testers.
  • CTA redirection page: campaign page.

39.png

 

Custom Targeted Email

It's possible to send targeted and fully customized emails from a test campaign.

Here's how:

  • Click on the "Send out email" button in the campaign header.

    40.png
  • Select recipients based on the desired status:

    • Invitation pending
    • Application pending/rejected
    • Testing
    • Test review pending
    • Test review validated

    → As a reminder, here are the different existing statuses

    41.png
  • Fill in the subject of your email.

  • Complete the body of your email.

  • Confirm sending.

    42.png

For your information, the date and time of the last email sent are displayed (in UTC) at the top of the recipient selection, to prevent multiple emails from being sent in error.

Similar to the Community Emails feature:

  • You can preview the desktop and mobile rendering.

  • You can test the email before sending it.

  • Only users with the permission SendEmail can send these emails.

  • These emails are displayed in the list of sent emails.

    43.png


FAQs


How to export testers delivery information?

Click on your campaign to open the details, then Download CSV. Make sure you have selected your testers beforehand.

44.png

Can I have multiple products in a campaign?

No, you can only add one product per campaign. If you want to put live a product testing with several products, we recommend using option 2 to manually add your bundle (make sure the image you upload is featuring all the products). Also make sure that your campaign’s description is introducing all the products.

How can I blacklist a tester?

If you select a member to test a product and that person ends up not leaving a review despite multiple flags/messages, use the Tag feature from the User table (Stats Users). You can call the Tag ‘Bad tester’ or ‘Do not select’. You will then see that information if that person applies for a new test, so you don’t select her for another chance to test.

It’s not working when I import a list to select testers

Please make sure that:

  • Your file only contains 1 column called “User Id“ (quotation marks included)
  • That there is no empty column or empty line
  • You have saved your file as a csv.

Contact your CSM if you’ve met all these criteria and are still experiencing the issue.

How can I ask for a candidate’s shade for a test?

When creating your product test, we recommend to add a dedicated Custom Field on the Step 4 called Survey. Click ‘Add a custom field’ and configure your question directly here.

  • If you only have few shades available, you can go for a Single choice question and list your shades in the Possibilities.
  • If you have a lot of shades, and don’t have the time to list them all, you can create a text field. Please keep in mind that this option could be less reliable as candidates could enter typos.

Make sure that you also link your Shade finder somewhere in your campaign’s description so that candidates can easily access it. You won’t be able to link it in your dedicated custom field.

Can I set up optional missions on a test?

No, all missions configured in a product test are mandatory to complete in order for a test to be finalized (if you have an all-time mission giving points for completing all the tasks in a product test, members will only be able to win points if they do all their testers’ missions).

If you don’t have an all-time mission giving points for completing all the tasks in a product test, testers can still do the testers’ tasks of their choice, and you can validate their test manually from the back office.

Can I export contributions left on Step 5?

It’s currently not possible to export contributions, but you can copy/paste verbatims or save images submitted. It’s in our backlog to make it possible in the future.

Was this article helpful?
0 out of 0 found this helpful