Comparative product test

from Wikipedia, the free encyclopedia

The comparative product test serves to determine and present the suitability for use , the utility value and the quality of products , insofar as these can be objectively determined. Originally developed for the evaluative examination of goods , the work processes were also transferred to the examination of services and further developed.

historical development

In the United States of America , the Consumers Union carried out comparative product tests as early as the 1930s.

After the Second World War, consumer organizations were established in European countries , such as the Union fédérale des consommateurs in France in 1951, the Consumentenbond in the Netherlands in 1953 , the Verbruikersunie in Belgium in 1957 and the Consumers Association in the United Kingdom in 1957 .

In German-speaking countries

In the early 1960s, some politicians who wanted to strengthen consumer protection , including Lucie Beyer , came up with the idea of ​​institutionalizing product testing in Germany as well. In 1961 the journalist and publisher Waldemar Schweitzer founded the magazine DM on his own initiative in Stuttgart . This was the first test magazine on the German market. It soon found its market and caused a sensation with product studies and clear customer information. Business representatives generally believed that consumers could also obtain sufficient information from the suppliers and manufacturers of products about their properties and quality. Nevertheless, on December 4, 1964, by resolution of the German Bundestag, the Federal Republic of Germany established the legally responsible and independent Stiftung Warentest under civil law.

Registered trademark of Stiftung Warentest

Under the leadership of the later head of Stiftung Warentest, Roland Hüttenrauch , the company developed the appropriate method for carrying out and publishing the tests. The procedure was recorded in the relevant standards from the end of the 1960s to the 1980s (see below DIN 66051, 66052 and 66054). Stiftung Warentest published regularly in their publications on the corresponding determined by their results, especially in the magazines test and financial test and on its Internet portal test.de . Many suppliers of above-average tested products advertise their products with test logos.

In Austria, the Association for Consumer Information (VKI) was founded as early as 1961 , which, in addition to consumer advice, also deals with comparative product tests. The Association for Consumer Information also publishes its results regularly in the journal Konsument .

In December 2014, the Federal Ministry of Justice and Consumer Protection (BMJV), under the leadership of Federal Minister Heiko Maas, launched the Who tests the testers initiative, which is a voluntary commitment by test organizers with regard to the practice of carrying out product tests. The Stiftung Warentest , Ökotest and the computer magazine c't will be among the first to sign the voluntary commitment .

Legal situation in Germany

The publication of a comparative product test that is not for competition purposes is permitted if the investigation on which the report is based was carried out neutrally, competently and objectively in the sense of an endeavor to achieve objective correctness and both the type of procedure during the test and that resulting from the investigations The conclusions drawn are justifiable, that is, appear debatable. Test institutes are given considerable discretion due to the right to freedom of expression, protected by Article 5 of the Basic Law . However, publication is no longer acceptable if, in violation of Section 824 (1) of the Civil Code, false facts are alleged or the method of investigation or the conclusions drawn no longer appear to be debatable and a statement to be regarded as a value judgment is therefore illegal in the section 823 ( 1) 1 of the German Civil Code, it intervenes immediately.

For the interpretation to be made whether it is a factual assertion or an expression of opinion - the latter is present if the factual content of the evidence-based examination is inaccessible, a factual assertion, however, if the statement is predominantly characterized by the presentation of actual events and at the same time the addressees Presentation of specific processes covered in the evaluation, which as such is accessible to verification using the means of evidence - in addition, when publishing test results, the reference to the evaluation must also be particularly observed for factual claims. Only if the actual findings in the context of the test are of independent significance, i.e. they are not only subordinate to the value judgment as dependent evaluation elements, and are therefore understood by the average reader as a statement about verifiable facts and the basis for their own quality judgment about the tested product, they are to be viewed independently of the test result, which is generally to be assessed as an expression of opinion.

internationalization

The idea of ​​carrying out product tests jointly in an international framework makes sense for various reasons:

On the one hand, procurement and testing costs can be reduced if the products to be examined are available in different countries and the quality criteria in the various social environments can be determined according to similar standards, which results in a favorable market overlap.

In addition, a common procedure makes it possible to evaluate and present the test results according to standardized and therefore not contradicting criteria for consumers in different countries.

In addition, general and specific experiences and knowledge are exchanged through international cooperation, which can be used to improve or optimize the test methodology and test procedures.

The international umbrella organization International Consumer Research & Testing (ICRT) based in London was established in the 1990s for comparative product testing . It now includes over 40 neutral consumer organizations worldwide. For example, the members are not allowed to publish any product advertising in their publications and are also bound by further guidelines as part of their collaboration.

Process of a product test

In Germany only Stiftung Warentest carries out comparative studies of goods and services according to strictly scientific methods and with the standardized work processes described below.

After a product type that is to be examined has been determined, a series of standardized work steps must be initiated and carried out before the examination results can be evaluated and published.

Market analysis

Market analysts observe what is happening in the market and research the product range both in the market and directly from the providers. The market importance of the various products and providers is also determined.

Product selection

After the research, it must be decided and stipulated how many and which products are to be included in the investigation. In order to restrict and ensure that the products are largely comparable, retail prices and features are also taken into account.

Individual providers can express their wish to include or not include certain products, but are not entitled to be considered.

Procurement of test samples

The test samples to be examined are obtained anonymously from retailers and are generally not made available by the providers. This is to ensure that products that are ready for the market as well as precisely those products that consumers can buy in stores are tested.

In exceptional cases, such as very new or seasonal offers that are not yet available in free trade, test samples can be "drawn", that is, provided that there is a larger selection of products intended for sale in the supplier's inventory or the manufacturer randomly selects the test samples to be examined. These products are also available for purchase.

Investigation program

The test methods according to which all products included are to be examined must be compiled by scientific staff. In doing so, the state of the art and the relevant standards, but also further considerations, are taken into account. In the case of innovative products, there are usually no standards at all that could be applied, so that the corresponding test points have to be completely redrafted. Advisory boards are invited for each individual test project . These are staffed according to the topic with representatives of the providers and consumers as well as neutral experts in order to discuss the study design. The advisory board only has an advisory role, the final research program is determined by the scientific staff.

Testing institute

After the product selection and the test program have been determined and the test samples have been obtained, the tests can be carried out. Since it is usually not economical for the institution carrying out the comparative product test to run its own test laboratories, the test orders are usually awarded to external, neutral test institutes according to a tendering process.

In the test institutes, all products included are anonymized and tested according to the same standards and in accordance with the specifications of the respective test program. The results are documented by the testing institute and submitted in the form of an expert report .

evaluation

The evaluation of the metrological and subjective results is based on scientific and statistical methods. The individual evaluations are usually weighted linearly and summarized with the help of a benefit analysis . Furthermore, these assessments can be translated into school grades and can be formulated as a decimal number , as a symbol and / or semantically , for example with the predicates "very good", "good", "satisfactory", "sufficient" and "poor" .

However, the results depend on the weightings; even small changes in the weightings by a few percentage points can significantly influence the result of a product test. This finding is significant against the background that the weights in many test organs are multiples of 5% or even multiples of 10%, which is not objectively justifiable, but is due to the decimal system.

Individual, relatively bad partial or group results may mathematically only have a small effect on the overall assessment. In order to nevertheless enable a consumer-friendly assessment, devaluation effects can be determined during the evaluation, which is particularly important in the case of safety aspects, for example in the case of inadequate electrical safety or the presence of hazardous substances.

The objective results are made known to the providers involved before they are published (provider information).

The calculations, their verbalization and the texts of the publications are checked by verifiers for quality assurance and compared with the reports.

publication

The results of the studies are edited by journalists and published together with the product prices in periodicals , monographs or on the Internet . The median for each product is determined from the different product prices found when the test products were purchased in stores and expressed as the "average price in euros approx." expelled. As a result, consumers (of course also competitors) receive useful additional information in the form of a price comparison which, however, because of the possibility of rapid price adjustments and price changes, has a lower "information shelf life" than the product qualities determined. Equipment details and test results of the various products are usually published in table or list form for better comparability .

Other media can quote the test results, and vendors can also advertise the test results on their products.

Presentation of the test results

Most test organizations use symbols on a five-fold scale for a clear and easy-to-understand presentation . For a more precise differentiation between assessments and semantics , many test organizations orientate themselves on the respective school grading system . In international group tests, based on an integer number from one to five, a continuous scale from 0.5 to 5.5 has been established, with a higher number representing a better judgment.

The following table shows some examples:

Integer
valuation		 Moving
valuation		 ICRT Consumer
Reports		 Stiftung Warentest Which? EuroConsumers Consumer bond Union fédérale des
consommateurs
International United States
of America		 Germany United
Kingdom		 Belgium Netherlands France
number numeric
range		 symbol semantics semantics numeric
range		 symbol semantics numeric
range		 symbol symbol numeric
range		 numeric
range		 symbol
5 4,500 - 5,500 + + very good excellent 81-100 + + very good 0.5 - 1.5 ***** A. 80% - 100% 8.2 - 10.0 * * *
4th 3,500 - 4,499 + good very good 61 - 80 + Well 1.6 - 2.5 **** B. 60% - 80% 6.4 - 8.2 * *
3 2,500 - 3,499 O sufficient good 41-60 O satisfying 2.6-3.5 *** C. 40% - 60% 4.6 - 6.4 *
2 1,500 - 2,499 - less sufficient fair 21 - 40 ϴ sufficient 3.6 - 4.5 ** D. 20% - 40% 2.8 - 4.6 ■
1 0.500 - 1.499 - - bath poor 0-20 - inadequate 4.6 - 5.5 * E. 0% - 20% 1.0 - 2.8 ■ ■

literature

  • Helga Brennecke: The comparative product test: an investigation of its possibilities and limits with regard to the consumer's market overview , University of Göttingen, dissertation (1965)
  • Peter Ditgen: The comparative product test as an instrument of consumer information , dissertation, Cologne (1966)
  • Hugo Eugen Huber: Comparative product test and unfair competition , edition 339 of Zurich contributions to jurisprudence, Verlag Schulthess (1970)
  • Udo Beier: Comparative product tests - tasks, results and possibilities , reports from the teaching and research unit Economics of the Household and Consumer Policy , University of Hamburg (1976)
    • also in: Edgar Topritzhofer (editor): Marketing. New results from research and practice , Gabler Business Publishing House, Wiesbaden (1978)
  • Roland Hüttenrauch : On the methodology of the comparative product test , Journal of Consumer Policy, Springer Netherlands, 1, 2 (March 1977), pages 143 to 150 doi : 10.1007 / BF00380449
  • Richard T. Cary, George B. Sproles: Evaluation Product Testing Methods: A Theoretical Framework , in: Home Economics Research Journal , Volume 7, Number 1 (September 1978), pages 66 to 75
  • Günter Silberer: Starting points and problems of assessing the success of the neutral goods test , in: Zeitschrift für Konsumentpolitik , year 1979, issue 2, page 110 ff.
  • Hans Raffée : Product test and company - use, effects and assessment of the comparative product test in industry and trade , Volume 360 ​​from Campus Research, Research Association Empirical Consumer Research , Campus-Verlag (1984), ISBN 9783593332949
  • Hans Raffée (Editor: Günter Silberer): Product test and consumer - Use, effects and assessment of the comparative product test in the consumer sector , Volume 361 by Campus Research, Research Association Empirical Consumer Research , University of Mannheim, Research Group Consumer Information , Campus-Verlag, Frankfurt am Main, New York (1984), ISBN 9783593332956
  • International Organization of Consumers Unions (IOCU): Guide to the Principles of Comparative Testing (1985), ISBN 967-9973-03-4
  • Norbert Horn, publisher Hartwig Piepenbrock, comparative product test - test practice, test advertising, case law , Landsberg am Lech, modern industry (1986)
  • Corinna Seel: Comparative test of goods in the Federal Republic , University of Applied Sciences Stuttgart - University for Library and Information Science (1989)
  • Horst Dürr: The overall judgment in the comparative product test - structure and accuracy , in: Hauswirtschaft und Wissenschaft , Numbers 2 and 3, Deutsche Gesellschaft für Hauswirtschaft (1993), pages 84 to 99
  • Report of the Second Berlin Seminar on Comparative Goods Test in Europe , Stiftung Warentest, Berlin (1994)
  • Roland Hüttenrauch: Usability and practical value , in: Handbuch Qualitätmanagement , Chapter 35, fourth edition, Hanser-Verlag, Munich (1999)
  • Lutz Kosbab: On the way to the comparative product test - influencing factors for planning and implementation in magazines (PDF; 248 kB), seminar paper, University of Leipzig, Institute for Communication and Media Studies, Leipzig (summer 2003)
  • Rieke Havertz: Legal issues and liability for product tests , term paper at the Institute for Communication and Media Studies at the University of Leipzig, seminar "Utility Value Journalism" with Andreas Eickelkamp (2003)
  • Silja Halbes: The comparative product test to support sustainable consumption - test practice of the Stiftung Warentest and comparable European test organizations (PDF; 698 kB) , teaching and research report , number 52, University of Hanover, Institute for Business Research, Hanover (July 2003)
  • Werner Brinkmann and Peter Sieber: Usability, practical value and quality , in: Masing Handbook Quality Management , Chapter 35, edited by Tilo Pfeifer and Robert Schmitt, fifth, completely revised edition, Hanser-Verlag, Munich (2007), pages 777 to 786, ISBN 978-3-446-40752-7
  • Rolf Muntwyler: Influence of product tests on consumers and providers , Master's thesis, ETH Zurich (2009)
  • Markus Bautsch: Usability and practical value , Chapter 35 in: Tilo Pfeifer, Robert Schmitt (editor) Masing Handbook Quality Management , Carl Hanser Fachbuchverlag Munich Vienna, 6th revised edition (2014), ISBN 978-3-446-43431-8
  • Ulrich Franz: Comparative product test , in: Competition in Law and Practice , 12/2015, pages 1425 to 1431

Norms

German standards

  • DIN 55350-11: Terms for quality management (May 2008), supplement to DIN EN ISO 9000: 2005
  • DIN 66050: Usability - Concept (August 1980)
  • DIN 66051: Examination of goods - General principles (October 1967)
  • DIN 66052: product test - term (November 1971)
  • DIN 66054: Goods test - principles for technical implementation (August 2017)

International standards

  • DIN EN ISO 9000: 2005-12: Quality management systems - basics and terms (see also quality management standard )
  • EN ISO 9241 - Part 11: Ergonomic requirements for office work with display screen equipment - Requirements for usability - Guidelines
  • ISO / IEC Guide 46: Comparative Testing of Consumer Products and Related Services - General Principles (1985)

Individual evidence

  1. ↑ a b c d e f g h i j Markus Bautsch: Usability and practical value , Chapter 35 in: Tilo Pfeifer, Robert Schmitt (editor) Masing Handbook Quality Management , Carl Hanser Fachbuchverlag Munich Vienna, 6th revised edition (2014), ISBN 978 -3-446-43431-8
  2. ↑ Consumers Union / Consumer Reports 2009 Annual Report ( Memento of the original from March 4, 2016 in the Internet Archive ) Info: The archive link was inserted automatically and has not yet been checked. Please check the original and archive link according to the instructions and then remove this notice. (PDF; 3.1 MB), page 2 @1@ 2Template: Webachiv / IABot / www.consumerreports.org
  3. ↑ Non-governmental PUS initiatives in France  ( page no longer available , search in web archives )  Info: The link was automatically marked as defective. Please check the link according to the instructions and then remove this notice. (PDF; 186 kB) III - Consumers' movement - Acteurs non gouvernementaux de la consommation@1@ 2Template: Toter Link / lisec.unistra.fr  
  4. ↑ Member Profile Consumentenbond (Council) (English)
  5. ↑ Test Aankoop ( Memento of the original from July 19, 2011 in the Internet Archive ) Info: The archive link was inserted automatically and has not yet been checked. Please check the original and archive link according to the instructions and then remove this notice. , Wie zijn wij (Flemish) @1@ 2Template: Webachiv / IABot / www.test-aankoop.be
  6. ↑ Which? Key Facts , (English)
  7. ↑ 40 Years Consumer - First consumer magazine
  8. ↑ “Who tests the testers?” Initiative started - rules of good professional testing practice published ( memento of the original of July 21, 2015 in the Internet Archive ) Info: The archive link was automatically inserted and not yet checked. Please check the original and archive link according to the instructions and then remove this notice. , BMJV of December 1, 2014, accessed on December 2, 2014 @1@ 2Template: Webachiv / IABot / www.bmjv.de
  9. ↑ Interview WamS - Who tests the testers? ( Memento of the original from July 15, 2015 in the Internet Archive ) Info: The archive link was inserted automatically and has not yet been checked. Please check the original and archive link according to the instructions and then remove this notice. , BMJV of December 1, 2014, accessed on December 2, 2014 @1@ 2Template: Webachiv / IABot / www.bmjv.de
  10. ↑ a b c BGH, December 9, 1975, file number VI ZR 157/73: liability of the Stiftung Warentest for comparative test (with notes by Tilmann) , Neue Juristische Wochenschrift, issue 14 (1976), pages 620 ff.
  11. ↑ BGH, March 10, 1987, file number VI ZR 144/86: Comparative product test with requirements going beyond DIN standards , at lexitus.com
  12. ^ Business consultant (1987), pages 922 and 924
  13. ↑ Commercial legal protection and copyright (1997), page 942 ff.
  14. ↑ BGH, June 17, 1997, file number VI ZR 114/96: For the correct implementation of a product test carried out by Stiftung Warentest and for the content of the report on the results, if the test included an entity (here: printer with connection line) , BGH Edition , Carl Heymanns Verlag (online)
  15. ^ Emanuel Burghardt in: The right of word and picture reporting , 5th edition (2003), chapter 10, paragraph 118
  16. ↑ BGH, January 24, 2006, file number XI ZR 384/03: Federal Court of Justice decides on the action for a declaration of damages by Dr. Kirch against Deutsche Bank AG and Dr. Breuer , at lexetius.com
  17. ^ ICRT - About us
  18. ^ ICRT Our Members
  19. ↑ Application for membership of International Consumer Research & Testing Ltd (ICRT) ( Memento of the original from September 27, 2011 in the Internet Archive ) Info: The archive link has been inserted automatically and has not yet been checked. Please check the original and archive link according to the instructions and then remove this notice. ( MS Word ; 96 kB) IV. @1@ 2Template: Webachiv / IABot / www.international-testing.org
  20. ↑ About us: The Stiftung Warentest introduces itself
  21. ^ Statutes of the Stiftung Warentest , § 10 The Advisory Boards and their tasks
  22. ↑ Test institutes: Call for applications for test orders
  23. ↑ Dominik Rohn, Karsten Weihe: Are rankings inherently arbitrary? And how does that affect the results? , Research and Teaching 9/2013, accessed on May 31, 2014
  24. ↑ Publications: Competent consumer tips on many channels
  25. ↑ Hans-Otto Schenk: Price comparisons. In: Hermann Diller / Andreas Herrmann (eds.): Handbuch Preispolitik, Wiesbaden 2003, pp. 791–810.
  26. ↑ Arndt Joachim Nagel and Fabian Karg: Advertising with test results: Legal analysis and overview of case law
  27. ↑ Horst Dürr: The overall assessment in the comparative product test - structure and accuracy , Chapter 2: Assessment scales
  28. ↑ a b IOCU Testing Committee: Guide to the principles of comparative testing , 1985, Chapter III.5: Ranking scales
  29. ↑ Best Phones - Basic features matter most (PDF; 465 kB), Consumer Reports, February 2004, page 23
  30. ↑ a b Hans-Dieter Lösenbeck: Stiftung Warentest A Review , Chapter 6: The Methodical Basics in Change , p. 103
  31. ↑ See, for example, see legend of the assessment limits in the table footer, test.de, accessed online on March 7, 2013
  32. ↑ See for example: Riz thaï: Un solide challenger , Que Choisir, accessed online March 7, 2013