T.r.O	T.r.R	Methodology.expertise.required.O	Opportunity.for.expectancy.bias.O	Opportunity.for.lack.of.diligence.O	Surprising.result.O	Exciting.result.O	Internal.conceptual.replications.O	Successful.conceptual.replications.O	Internal.direct.replications.O	Successful.direct.replications.O	Feasibility.O	Status.R	Domain.expertise.R	Method.expertise.R	Total.publications.R	Peer.reviewed.articles.R	Citations.R	Implementation.quality.R	Data.collection.quality.R	Replication.similarity.R	Effect.similarity.R	Findings.similarity.R	Difficulty.of.implimentation.R	Area.of.expertise.R
0,00464002	0,105891025	Moderate expertise required	Slight opportunity for researcher expectations to influence results	Slight opportunity for lack of diligence to affect the results	3,67	4,67	0	0	0	0	0	NA	Slight Expertise	Some Expertise	13	5	1875	was about the same quality as the original study	was worse than the average study	Extremely similar	Moderately similar	Moderately similar	Very challenging	Social
0,022542373	0,023841537	Strong expertise required	No opportunity for researcher expectations to influence results	No opportunity for lack of diligence to affect the results	2,75	2,75	0	0	0	0	0	1	Slight Expertise	Some Expertise	3	2	2	was about the same quality as the original study	was about the same as the average study	Virtually identical	Virtually identical	Extremely similar	Not at all challenging	Social
0,127392361	0,018376516	No expertise required	No opportunity for researcher expectations to influence results	Slight opportunity for lack of diligence to affect the results	2	3	2	2	0	0	0	NA	Slight Expertise	Slight Expertise	39	30	2201	was about the same quality as the original study	was about the same as the average study	Somewhat similar	Slightly similar	Slightly similar	Not at all challenging	Personality
0,130782132	0,120519146	No expertise required	No opportunity for researcher expectations to influence results	Slight opportunity for lack of diligence to affect the results	4	2,5	0	0	0	0	0	NA	Some Expertise	Some Expertise	31	23	388	was about the same quality as the original study	was about the same as the average study	Extremely similar	Virtually identical	Extremely similar	Moderately challenging	Behavioral neuroscience/Comparative
0,139816632	0,0294047	Extreme expertise required	Slight opportunity for researcher expectations to influence results	Moderate opportunity for lack of diligence to affect the results	3,67	3,67	0	0	0	0	0	1	High Expertise	Slight Expertise	14	7	36	was of slightly lower quality than the original study	was about the same as the average study	Moderately similar	Virtually identical	Virtually identical	Very challenging	Social
0,160955695	0,14406846	Strong expertise required	Slight opportunity for researcher expectations to influence results	Slight opportunity for lack of diligence to affect the results	2,75	3,25	1	1	0	0	0	1	Slight Expertise	Slight Expertise	7	4	122	was about the same quality as the original study	was better than the average study	Virtually identical	Extremely similar	Extremely similar	Moderately challenging	Social
0,167288593	0,03675175	Strong expertise required	Moderate opportunity for researcher expectations to influence results	Strong opportunity for lack of diligence to affect the results	2,33	2,67	4	4	0	0	0	1	Slight Expertise	No Expertise	0	0	0	was about the same quality as the original study	was about the same as the average study	Extremely similar	Somewhat similar	Very similar	Very challenging	Personality
0,172960188	0,061707156	Moderate expertise required	Moderate opportunity for researcher expectations to influence results	Slight opportunity for lack of diligence to affect the results	3,4	2,8	1	1	0	0	0	NA	High Expertise	High Expertise	61	41	NA	was about the same quality as the original study	was about the same as the average study	Extremely similar	Slightly similar	Somewhat similar	Not at all challenging	Social
0,178477629	0,08323764	No expertise required	Slight opportunity for researcher expectations to influence results	Slight opportunity for lack of diligence to affect the results	1,75	2,75	0	0	0	0	0	1	High Expertise	High Expertise	37	36	452	was about the same quality as the original study	was about the same as the average study	Moderately similar	Moderately similar	Moderately similar	Moderately challenging	Cognitive
0,185849827	0,003001488	No expertise required	No opportunity for researcher expectations to influence results	Slight opportunity for lack of diligence to affect the results	4	5,33	0	0	0	0	0	1	Slight Expertise	Slight Expertise	80	32	1995	was about the same quality as the original study	was about the same as the average study	Somewhat similar	Not at all similar	Not at all similar	Not at all challenging	Developmental
0,188662549	-0,030172295	Slight expertise required	Slight opportunity for researcher expectations to influence results	Slight opportunity for lack of diligence to affect the results	3,5	3,6	0	0	0	0	0	NA	Some Expertise	Some Expertise	8	5	258	was of slightly higher quality than the original study	was better than the average study	Virtually identical	Not at all similar	Slightly similar	Moderately challenging	Social
0,188662549	0,018283411	Slight expertise required	Slight opportunity for researcher expectations to influence results	Slight opportunity for lack of diligence to affect the results	3,5	3,6	0	0	0	0	0	NA	Some Expertise	Some Expertise	8	5	258	was of slightly higher quality than the original study	was better than the average study	Virtually identical	Not at all similar	Slightly similar	Moderately challenging	Social
0,195136354	0,24687812	No expertise required	No opportunity for researcher expectations to influence results	No opportunity for lack of diligence to affect the results	3	3,33	0	0	0	0	0	1	Some Expertise	Some Expertise	5	5	7	was about the same quality as the original study	was about the same as the average study	Virtually identical	Virtually identical	Virtually identical	Not at all challenging	Behavioral neuroscience/Comparative
0,20573686	0,094021673	Slight expertise required	Slight opportunity for researcher expectations to influence results	Slight opportunity for lack of diligence to affect the results	3,12	3,25	4	4	0	0	0	1	Some Expertise	Some Expertise	2	2	21	was about the same quality as the original study	was slightly better than the average study	Extremely similar	Not at all similar	Not at all similar	Somewhat challenging	Developmental
0,207643072	0,04449582	Moderate expertise required	Slight opportunity for researcher expectations to influence results	Slight opportunity for lack of diligence to affect the results	2,32	3,18	5	5	3	3	0	1	Some Expertise	Some Expertise	14	9	206	was about the same quality as the original study	was slightly better than the average study	Extremely similar	Slightly similar	Moderately similar	Not at all challenging	Social
0,208058463	0,155043132	No expertise required	Moderate opportunity for researcher expectations to influence results	Strong opportunity for lack of diligence to affect the results	3,75	3	1	1	0	0	0	1	Moderate Expertise	Moderate Expertise	324	310	6714	was about the same quality as the original study	was about the same as the average study	Extremely similar	Not at all similar	Not at all similar	Not at all challenging	Personality
0,20996855	0,500179963	No expertise required	Slight opportunity for researcher expectations to influence results	Slight opportunity for lack of diligence to affect the results	2,67	4	1	1	0	0	0	NA	Some Expertise	Some Expertise	0	0	0	was about the same quality as the original study	was about the same as the average study	Extremely similar	Extremely similar	Very similar	Not at all challenging	Psychopathology
0,212014281	0,118808574	Slight expertise required	No opportunity for researcher expectations to influence results	Slight opportunity for lack of diligence to affect the results	2,5	3	3	3	0	0	0	1	Slight Expertise	Moderate Expertise	27	9	78	was about the same quality as the original study	was about the same as the average study	Virtually identical	Not at all similar	Slightly similar	Somewhat challenging	Industrial/organizational
0,21368683	-0,048918238	Extreme expertise required	Slight opportunity for researcher expectations to influence results	Extreme opportunity for lack of diligence to affect the results	4,5	3,75	0	0	0	0	0	NA	Slight Expertise	No Expertise	0	0	0	was of slightly lower quality than the original study	was about the same as the average study	Extremely similar	Not at all similar	Slightly similar	Somewhat challenging	Cognitive
0,219359299	0,064661345	Moderate expertise required	No opportunity for researcher expectations to influence results	No opportunity for lack of diligence to affect the results	3,5	4,5	1	1	0	0	0	1	No Expertise	Slight Expertise	14	11	102	was about the same quality as the original study	was about the same as the average study	Extremely similar	Somewhat similar	Moderately similar	Very challenging	Social
0,219666896	-0,004719346	Slight expertise required	Strong opportunity for researcher expectations to influence results	Strong opportunity for lack of diligence to affect the results	2	2,75	0	0	0	0	0	1	Slight Expertise	Slight Expertise	9	7	165	was of slightly lower quality than the original study	was about the same as the average study	Very similar	Not at all similar	Not at all similar	Moderately challenging	Social
0,222131584	0,073353737	Slight expertise required	Slight opportunity for researcher expectations to influence results	Slight opportunity for lack of diligence to affect the results	2,71	3	0	0	0	0	0	1	Slight Expertise	Some Expertise	0	0	0	was of moderately lower quality than the original study	was slightly worse than the average study	Moderately similar	Somewhat similar	Moderately similar	Slightly challenging	Personality
0,222330235	0,104941786	Slight expertise required	Strong opportunity for researcher expectations to influence results	Moderate opportunity for lack of diligence to affect the results	4,33	3,33	1	1	0	0	0	NA	Moderate Expertise	Some Expertise	12	10	105	was of slightly higher quality than the original study	was about the same as the average study	Extremely similar	Not at all similar	Slightly similar	Somewhat challenging	Clinical
0,224092029	0,019422053	Slight expertise required	Slight opportunity for researcher expectations to influence results	Moderate opportunity for lack of diligence to affect the results	3,17	3,67	2	0	0	0	0	1	Slight Expertise	Moderate Expertise	12	9	292	was about the same quality as the original study	was about the same as the average study	Very similar	Somewhat similar	Somewhat similar	Not at all challenging	Cognitive
0,225490086	-0,052290282	Slight expertise required	Moderate opportunity for researcher expectations to influence results	Strong opportunity for lack of diligence to affect the results	3,5	4,5	0	0	0	0	0	1	Some Expertise	High Expertise	200	85	8529	was of slightly lower quality than the original study	was slightly better than the average study	Very similar	Not at all similar	Slightly similar	Slightly challenging	Social
0,228739615	-0,006108358	Slight expertise required	Moderate opportunity for researcher expectations to influence results	Slight opportunity for lack of diligence to affect the results	4	4,33	0	0	0	0	0	1	Some Expertise	Some Expertise	4	2	12	was about the same quality as the original study	was about the same as the average study	Virtually identical	Not at all similar	Moderately similar	Moderately challenging	Social
0,229852265	0,066130007	Extreme expertise required	Slight opportunity for researcher expectations to influence results	Moderate opportunity for lack of diligence to affect the results	3,5	3,75	0	0	0	0	0	1	Moderate Expertise	High Expertise	38	32	1268	was of slightly lower quality than the original study	was slightly worse than the average study	Moderately similar	Moderately similar	Moderately similar	Extremely challenging	Social
0,233776428	0,044266281	Slight expertise required	Slight opportunity for researcher expectations to influence results	Slight opportunity for lack of diligence to affect the results	4,6	3,6	3	3	0	0	0	NA	Slight Expertise	Some Expertise	12	8	247	was about the same quality as the original study	was about the same as the average study	Virtually identical	Somewhat similar	Somewhat similar	Not at all challenging	Social
0,246947019	0,179397898	Extreme expertise required	No opportunity for researcher expectations to influence results	Extreme opportunity for lack of diligence to affect the results	3,67	3	0	0	0	0	0	NA	High Expertise	High Expertise	47	35	607	was of slightly higher quality than the original study	was about the same as the average study	Virtually identical	Moderately similar	Moderately similar	Not at all challenging	Social
0,259958534	0,15539539	Moderate expertise required	Slight opportunity for researcher expectations to influence results	Slight opportunity for lack of diligence to affect the results	3	3	3	3	0	0	0	1	High Expertise	Some Expertise	11	3	715	was about the same quality as the original study	was slightly worse than the average study	Somewhat similar	Somewhat similar	Somewhat similar	Not at all challenging	Social
0,268278965	-0,101637251	No expertise required	Slight opportunity for researcher expectations to influence results	No opportunity for lack of diligence to affect the results	2	3,33	2	2	0	0	0	1	Slight Expertise	High Expertise	7	3	5	was of slightly lower quality than the original study	was about the same as the average study	Extremely similar	Not at all similar	Very similar	Slightly challenging	Social
0,274010238	0,073797292	No expertise required	No opportunity for researcher expectations to influence results	Slight opportunity for lack of diligence to affect the results	3,5	4,25	1	1	0	0	0	1	High Expertise	High Expertise	22	22	830	was of much higher quality than the original study	was much better than the average study	Extremely similar	Not at all similar	Not at all similar	Slightly challenging	Social
0,28378815	-0,175454592	No expertise required	Slight opportunity for researcher expectations to influence results	Moderate opportunity for lack of diligence to affect the results	3,11	2,94	2	2	0	0	0	NA	Slight Expertise	Some Expertise	4	4	138	was about the same quality as the original study	was about the same as the average study	Extremely similar	Not at all similar	Not at all similar	Not at all challenging	Decision making
0,28771881	0,322727228	No expertise required	No opportunity for researcher expectations to influence results	No opportunity for lack of diligence to affect the results	2,67	4,33	0	0	0	0	0	NA	Moderate Expertise	Slight Expertise	37	13	450	was about the same quality as the original study	was about the same as the average study	Extremely similar	Virtually identical	Very similar	Moderately challenging	Quantitative
0,3	0,27	Slight expertise required	Slight opportunity for researcher expectations to influence results	Slight opportunity for lack of diligence to affect the results	3,75	4	0	0	0	0	0	1	Some Expertise	Some Expertise	9	7	165	was about the same quality as the original study	was slightly better than the average study	Extremely similar	Extremely similar	Virtually identical	Slightly challenging	Social
0,304772411	0,434510306	No expertise required	No opportunity for researcher expectations to influence results	Slight opportunity for lack of diligence to affect the results	2,75	2,5	2	2	0	0	0	3	Moderate Expertise	Moderate Expertise	80	50	2002	was about the same quality as the original study	was better than the average study	Virtually identical	Virtually identical	Virtually identical	Very challenging	Cognitive
0,31	-0,034	Slight expertise required	Moderate opportunity for researcher expectations to influence results	Slight opportunity for lack of diligence to affect the results	4,4	3	1	1	0	0	0	NA	Slight Expertise	Some Expertise	19	12	373	was about the same quality as the original study	was about the same as the average study	Very similar	Not at all similar	Not at all similar	Somewhat challenging	Cognitive
0,317462994	-0,1351	Moderate expertise required	Moderate opportunity for researcher expectations to influence results	Moderate opportunity for lack of diligence to affect the results	1,4	2,6	0	0	0	0	0	1	Moderate Expertise	Some Expertise	22	13	334	was about the same quality as the original study	was slightly better than the average study	Very similar	Somewhat similar	Somewhat similar	Moderately challenging	Social
0,322574106	0,2	Slight expertise required	Strong opportunity for researcher expectations to influence results	Strong opportunity for lack of diligence to affect the results	1,33	2,33	2	2	0	0	0	5	High Expertise	Moderate Expertise	40	20	616	was about the same quality as the original study	was better than the average study	Very similar	Very similar	Very similar	Not at all challenging	Social
0,333441051	0,225764222	Slight expertise required	Slight opportunity for researcher expectations to influence results	Slight opportunity for lack of diligence to affect the results	2	4	0	0	0	0	0	NA	Moderate Expertise	High Expertise	19	12	1532	was of slightly higher quality than the original study	was better than the average study	Virtually identical	Somewhat similar	Extremely similar	Slightly challenging	Social
0,341773488	0,103261105	No expertise required	No opportunity for researcher expectations to influence results	No opportunity for lack of diligence to affect the results	1,5	1	1	1	0	0	0	3	Slight Expertise	Moderate Expertise	15	13	489	was of moderately higher quality than the original study	was about the same as the average study	Virtually identical	Not at all similar	Slightly similar	Extremely challenging	Social
0,344312999	0,28970838	Strong expertise required	Moderate opportunity for researcher expectations to influence results	Strong opportunity for lack of diligence to affect the results	2	3	0	0	0	0	0	1	Slight Expertise	Slight Expertise	4	4	20	was about the same quality as the original study	was slightly better than the average study	Extremely similar	Very similar	Moderately similar	Slightly challenging	Social
0,347251138	0,161063754	Slight expertise required	Slight opportunity for researcher expectations to influence results	Moderate opportunity for lack of diligence to affect the results	3,75	3,75	3	2	0	0	0	3	Some Expertise	Moderate Expertise	80	32	1995	was about the same quality as the original study	was about the same as the average study	Very similar	Not at all similar	Somewhat similar	Not at all challenging	Developmental
0,348120689	0,2733272	No expertise required	No opportunity for researcher expectations to influence results	No opportunity for lack of diligence to affect the results	1,5	1,5	0	0	0	0	0	1	Slight Expertise	Slight Expertise	0	2	0	was of slightly higher quality than the original study	was slightly better than the average study	Extremely similar	Extremely similar	Very similar	Not at all challenging	Industrial/organizational
0,352175067	0,150236955	No expertise required	No opportunity for researcher expectations to influence results	Slight opportunity for lack of diligence to affect the results	3	4	3	3	0	0	0	1	High Expertise	Moderate Expertise	38	26	367	was about the same quality as the original study	was about the same as the average study	Virtually identical	Somewhat similar	Very similar	Slightly challenging	both social and I&O psych
0,363732358	0,284274426	No expertise required	No opportunity for researcher expectations to influence results	Slight opportunity for lack of diligence to affect the results	4	2,67	1	1	1	1	0	1	Moderate Expertise	Moderate Expertise	17	17	0	was about the same quality as the original study	was about the same as the average study	Very similar	Extremely similar	Very similar	Very challenging	Cognitive
0,366615713	0,101709161	Moderate expertise required	Slight opportunity for researcher expectations to influence results	Moderate opportunity for lack of diligence to affect the results	3,5	4,25	0	0	0	0	0	1	Some Expertise	Some Expertise	200	150	15633	was about the same quality as the original study	was about the same as the average study	Virtually identical	Slightly similar	Somewhat similar	Moderately challenging	behavioral/experimental economics
0,371775163	0,017674908	Slight expertise required	Slight opportunity for researcher expectations to influence results	No opportunity for lack of diligence to affect the results	4	3,33	0	0	0	0	0	NA	High Expertise	Moderate Expertise	7	4	122	was of slightly lower quality than the original study	was better than the average study	Extremely similar	Not at all similar	Not at all similar	Somewhat challenging	Social
0,374787884	0,411336583	No expertise required	No opportunity for researcher expectations to influence results	Slight opportunity for lack of diligence to affect the results	3,5	3,25	0	0	0	0	0	NA	Slight Expertise	Some Expertise	123	100	5240	was of slightly lower quality than the original study	was slightly better than the average study	Moderately similar	Extremely similar	Somewhat similar	Very challenging	Quantitative
0,377126878	0,076700677	Extreme expertise required	No opportunity for researcher expectations to influence results	Slight opportunity for lack of diligence to affect the results	4,67	3	0	0	0	0	0	3	Moderate Expertise	Moderate Expertise	50	30	2909	was about the same quality as the original study	was better than the average study	Extremely similar	Slightly similar	Somewhat similar	Slightly challenging	Social
0,378068955	0,379573968	Slight expertise required	No opportunity for researcher expectations to influence results	Slight opportunity for lack of diligence to affect the results	2,5	2,33	0	0	0	0	0	1	No Expertise	No Expertise	4	4	20	was about the same quality as the original study	was slightly better than the average study	Very similar	Extremely similar	Extremely similar	Moderately challenging	Social
0,378274916	-0,036935346	No expertise required	Slight opportunity for researcher expectations to influence results	Slight opportunity for lack of diligence to affect the results	2,6	3,4	1	1	0	0	0	1	Some Expertise	Moderate Expertise	5	4	114	was about the same quality as the original study	was better than the average study	Very similar	Moderately similar	Moderately similar	Somewhat challenging	Social
0,378345294	-0,030485538	No expertise required	No opportunity for researcher expectations to influence results	Slight opportunity for lack of diligence to affect the results	3,57	3,28	1	1	0	0	0	1	Some Expertise	Some Expertise	80	32	1995	was about the same quality as the original study	was about the same as the average study	Very similar	Not at all similar	Not at all similar	Not at all challenging	Developmental
0,379139495	-0,042140104	Moderate expertise required	No opportunity for researcher expectations to influence results	Slight opportunity for lack of diligence to affect the results	3	3,67	0	0	0	0	0	1	Moderate Expertise	Moderate Expertise	324	310	6714	was about the same quality as the original study	was about the same as the average study	Very similar	Not at all similar	Very similar	Somewhat challenging	Personality
0,38	0,25	No expertise required	No opportunity for researcher expectations to influence results	Slight opportunity for lack of diligence to affect the results	2,42	3,28	1	1	0	0	0	NA	Moderate Expertise	Moderate Expertise	18	14	248	was about the same quality as the original study	was slightly better than the average study	Extremely similar	Slightly similar	Extremely similar	Moderately challenging	Cognitive
0,381744212	-0,222920955	Slight expertise required	No opportunity for researcher expectations to influence results	Slight opportunity for lack of diligence to affect the results	2	3,33	0	0	0	0	0	NA	Moderate Expertise	Moderate Expertise	30	8	374	was about the same quality as the original study	was about the same as the average study	Virtually identical	Very similar	Very similar	Not at all challenging	Developmental
0,384260399	-0,034279559	Slight expertise required	No opportunity for researcher expectations to influence results	No opportunity for lack of diligence to affect the results	4	3	0	0	0	0	0	NA	Some Expertise	Moderate Expertise	84	78	1015	was of moderately higher quality than the original study	was better than the average study	Extremely similar	Not at all similar	Not at all similar	Moderately challenging	Quantitative
0,395559206	0,013045451	Extreme expertise required	Moderate opportunity for researcher expectations to influence results	Extreme opportunity for lack of diligence to affect the results	4	4	2	2	0	0	0	1	Some Expertise	Slight Expertise	1	1	1	was about the same quality as the original study	was about the same as the average study	Virtually identical	Not at all similar	Somewhat similar	Moderately challenging	Social
0,400010244	0,002839798	Strong expertise required	Moderate opportunity for researcher expectations to influence results	Extreme opportunity for lack of diligence to affect the results	5	4	1	1	0	0	0	NA	Some Expertise	Slight Expertise	154	130	5800	was of much higher quality than the original study	was much better than the average study	Extremely similar	Extremely similar	Not at all similar	Moderately challenging	Social
0,424979665	-0,215243835	Slight expertise required	Slight opportunity for researcher expectations to influence results	Slight opportunity for lack of diligence to affect the results	2,5	3	3	3	0	0	0	3	Moderate Expertise	Moderate Expertise	248	57	3751	was about the same quality as the original study	was better than the average study	Extremely similar	Not at all similar	Moderately similar	Moderately challenging	Cognitive
0,425496777	0,11385379	No expertise required	No opportunity for researcher expectations to influence results	Slight opportunity for lack of diligence to affect the results	3	3	4	4	0	0	0	1	Some Expertise	Some Expertise	4	4	45	was about the same quality as the original study	was about the same as the average study	Extremely similar	Slightly similar	Slightly similar	Moderately challenging	Social
0,43	0,11	Strong expertise required	Slight opportunity for researcher expectations to influence results	Moderate opportunity for lack of diligence to affect the results	4	4,67	0	0	0	0	1	NA	High Expertise	High Expertise	100	95	1062	was about the same quality as the original study	was about the same as the average study	Virtually identical	Very similar	Very similar	Somewhat challenging	Personality
0,431865646	0,011721165	No expertise required	Slight opportunity for researcher expectations to influence results	Slight opportunity for lack of diligence to affect the results	3,6	4	3	3	0	0	0	1	Slight Expertise	Some Expertise	80	32	1995	was about the same quality as the original study	was about the same as the average study	Very similar	Somewhat similar	Moderately similar	Not at all challenging	Developmental
0,445652636	0,423363806	Slight expertise required	No opportunity for researcher expectations to influence results	Slight opportunity for lack of diligence to affect the results	2,25	3,25	1	1	0	0	0	NA	Some Expertise	Some Expertise	11	25	609	was about the same quality as the original study	was slightly better than the average study	Virtually identical	Virtually identical	Virtually identical	Slightly challenging	Cognitive
0,461300742	0,134811802	No expertise required	No opportunity for researcher expectations to influence results	Slight opportunity for lack of diligence to affect the results	3	3,5	0	0	0	0	0	1	Some Expertise	Slight Expertise	32	30	706	was about the same quality as the original study	was about the same as the average study	Very similar	Moderately similar	Moderately similar	Moderately challenging	Cognitive
0,483442318	0,177837588	Slight expertise required	Slight opportunity for researcher expectations to influence results	Slight opportunity for lack of diligence to affect the results	2	3,67	2	0	0	0	0	NA	Some Expertise	Some Expertise	4	2	2	was about the same quality as the original study	was about the same as the average study	Extremely similar	Very similar	Very similar	Somewhat challenging	Education/school
0,496363588	0,505151268	Strong expertise required	Slight opportunity for researcher expectations to influence results	Slight opportunity for lack of diligence to affect the results	4	3,5	3	3	0	0	0	NA	High Expertise	High Expertise	40	36	1322	was about the same quality as the original study	was about the same as the average study	Extremely similar	Extremely similar	Extremely similar	Moderately challenging	Cognitive
0,498149178	0,102355162	Slight expertise required	Moderate opportunity for researcher expectations to influence results	Moderate opportunity for lack of diligence to affect the results	3,75	3,75	1	1	0	0	0	NA	High Expertise	High Expertise	44	33	2052	was of moderately higher quality than the original study	was slightly better than the average study	Very similar	NA	Not at all similar	Somewhat challenging	Social
0,501799075	-0,450187899	Moderate expertise required	Slight opportunity for researcher expectations to influence results	Slight opportunity for lack of diligence to affect the results	2,8	3,8	0	0	0	0	0	NA	Moderate Expertise	Slight Expertise	2	2	21	was about the same quality as the original study	was about the same as the average study	Virtually identical	Slightly similar	Slightly similar	Slightly challenging	Developmental
0,503449638	0,217562252	Slight expertise required	No opportunity for researcher expectations to influence results	No opportunity for lack of diligence to affect the results	3	4	3	3	0	0	0	1	Slight Expertise	Some Expertise	21	17	787	was of slightly lower quality than the original study	was about the same as the average study	Somewhat similar	Very similar	Very similar	Somewhat challenging	Social
0,516812354	0,315999964	Strong expertise required	Slight opportunity for researcher expectations to influence results	Slight opportunity for lack of diligence to affect the results	1,5	4,33	2	1	1	1	0	1	Some Expertise	Moderate Expertise	110	76	8089	was about the same quality as the original study	was about the same as the average study	Very similar	Very similar	Very similar	Moderately challenging	Cognitive neuroscience
0,52450217	0,524539034	Slight expertise required	Slight opportunity for researcher expectations to influence results	Moderate opportunity for lack of diligence to affect the results	2,5	3	0	0	0	0	0	1	Some Expertise	Some Expertise	2	2	9	was of slightly higher quality than the original study	was better than the average study	Moderately similar	Moderately similar	Slightly similar	Moderately challenging	Quantitative
0,551178255	0,349791589	Slight expertise required	Slight opportunity for researcher expectations to influence results	Slight opportunity for lack of diligence to affect the results	1,67	3	0	0	0	0	0	1	Moderate Expertise	High Expertise	16	12	1155	was about the same quality as the original study	was about the same as the average study	Extremely similar	Moderately similar	Extremely similar	Slightly challenging	Cognitive
0,554427187	0,091162691	No expertise required	No opportunity for researcher expectations to influence results	No opportunity for lack of diligence to affect the results	2,8	3,2	0	0	0	0	0	NA	Moderate Expertise	High Expertise	400	250	10759	was about the same quality as the original study	was slightly worse than the average study	Very similar	Not at all similar	Not at all similar	Somewhat challenging	Biological Psychology / Psychopharmacology
0,560499145	0,401939168	No expertise required	No opportunity for researcher expectations to influence results	No opportunity for lack of diligence to affect the results	2,67	3	0	0	0	0	0	1	Some Expertise	Slight Expertise	1	0	0	was about the same quality as the original study	was about the same as the average study	Very similar	Moderately similar	Slightly similar	Moderately challenging	Cognitive
0,561422534	-0,110614348	Slight expertise required	Slight opportunity for researcher expectations to influence results	Slight opportunity for lack of diligence to affect the results	3	3,75	2	2	0	0	0	1	Some Expertise	Slight Expertise	1	0	0	was about the same quality as the original study	was about the same as the average study	Extremely similar	Not at all similar	Moderately similar	Extremely challenging	Social
0,570693584	0,652730428	Moderate expertise required	No opportunity for researcher expectations to influence results	Slight opportunity for lack of diligence to affect the results	2,8	3,6	0	0	0	0	0	NA	Some Expertise	Some Expertise	16	5	2	was of slightly higher quality than the original study	was about the same as the average study	Extremely similar	Extremely similar	Very similar	Somewhat challenging	Cognitive
0,593405778	0,609913782	Slight expertise required	No opportunity for researcher expectations to influence results	Slight opportunity for lack of diligence to affect the results	1,5	2,5	0	0	0	0	0	NA	High Expertise	Slight Expertise	28	16	976	was about the same quality as the original study	was about the same as the average study	Virtually identical	Extremely similar	Extremely similar	Slightly challenging	Social
0,594605285	0,148340453	Moderate expertise required	No opportunity for researcher expectations to influence results	Strong opportunity for lack of diligence to affect the results	3,75	2,5	0	0	0	0	0	1	Moderate Expertise	High Expertise	120	48	5080	was about the same quality as the original study	was slightly better than the average study	Virtually identical	Somewhat similar	Moderately similar	Slightly challenging	Cognitive
0,594960462	0,395843475	Slight expertise required	Moderate opportunity for researcher expectations to influence results	Slight opportunity for lack of diligence to affect the results	3,66	4,33	0	0	0	0	0	1	Slight Expertise	Some Expertise	1	1	0	was about the same quality as the original study	was about the same as the average study	Extremely similar	Virtually identical	Very similar	Somewhat challenging	Behavioral neuroscience/Comparative
0,595271914	0,25414164	Slight expertise required	No opportunity for researcher expectations to influence results	No opportunity for lack of diligence to affect the results	5,2	4	2	2	1	1	0	NA	Slight Expertise	Some Expertise	25	11	609	was of slightly higher quality than the original study	was slightly better than the average study	Extremely similar	Not at all similar	Not at all similar	Moderately challenging	Cognitive
0,611120054	0,229604631	No expertise required	No opportunity for researcher expectations to influence results	Slight opportunity for lack of diligence to affect the results	3,28	2,86	0	0	0	0	0	3	Some Expertise	High Expertise	11	10	47	was about the same quality as the original study	was slightly better than the average study	Extremely similar	Somewhat similar	Very similar	Moderately challenging	Cognitive
0,623367433	0,480717115	No expertise required	No opportunity for researcher expectations to influence results	Slight opportunity for lack of diligence to affect the results	3,5	2,33	0	0	0	0	0	1	Some Expertise	Moderate Expertise	25	11	609	was about the same quality as the original study	was about the same as the average study	Extremely similar	Extremely similar	Very similar	Moderately challenging	Cognitive
0,649955571	0,497082522	Moderate expertise required	No opportunity for researcher expectations to influence results	No opportunity for lack of diligence to affect the results	5,33	5	1	1	0	0	0	NA	Moderate Expertise	High Expertise	40	37	766	was about the same quality as the original study	was slightly worse than the average study	Virtually identical	Not at all similar	Slightly similar	Not at all challenging	Cognitive
0,672084167	0,466443576	No expertise required	No opportunity for researcher expectations to influence results	No opportunity for lack of diligence to affect the results	2,7	3,2	0	0	0	0	0	1	Moderate Expertise	Moderate Expertise	10	7	316	was about the same quality as the original study	was about the same as the average study	Virtually identical	Moderately similar	Somewhat similar	Not at all challenging	Industrial/organizational
0,681152182	0,763508789	No expertise required	Slight opportunity for researcher expectations to influence results	No opportunity for lack of diligence to affect the results	2,2	3	0	0	0	0	0	NA	Slight Expertise	Moderate Expertise	31	21	432	was about the same quality as the original study	was better than the average study	Extremely similar	Virtually identical	Extremely similar	Slightly challenging	Social
0,685347348	0,527307869	Slight expertise required	No opportunity for researcher expectations to influence results	Slight opportunity for lack of diligence to affect the results	3,5	3	0	0	0	0	0	NA	Some Expertise	Some Expertise	15	12	373	was about the same quality as the original study	was about the same as the average study	Extremely similar	Very similar	Very similar	Somewhat challenging	Cognitive
0,698586719	0,780725807	Slight expertise required	No opportunity for researcher expectations to influence results	Slight opportunity for lack of diligence to affect the results	2,4	1,8	1	1	0	0	0	1	High Expertise	High Expertise	40	31	653	was of much higher quality than the original study	was much better than the average study	Extremely similar	Extremely similar	Extremely similar	Somewhat challenging	Cognitive
0,701088742	0,750404422	No expertise required	No opportunity for researcher expectations to influence results	No opportunity for lack of diligence to affect the results	3,6	3,2	0	0	0	0	0	NA	Some Expertise	Moderate Expertise	110	76	8108	was about the same quality as the original study	was about the same as the average study	Very similar	Somewhat similar	Moderately similar	Very challenging	Cognitive neuroscience
0,713921386	0,681560537	No expertise required	No opportunity for researcher expectations to influence results	No opportunity for lack of diligence to affect the results	3	3,5	0	0	0	0	0	1	High Expertise	High Expertise	46	19	509	was about the same quality as the original study	was about the same as the average study	Extremely similar	Extremely similar	Extremely similar	Moderately challenging	Cognitive
0,715143728	0,131411981	No expertise required	No opportunity for researcher expectations to influence results	No opportunity for lack of diligence to affect the results	1,33	1,67	0	0	0	0	0	1	Moderate Expertise	Moderate Expertise	2	2	0	was about the same quality as the original study	was about the same as the average study	Very similar	Moderately similar	Moderately similar	Moderately challenging	Quantitative
0,721890032	0,922934494	Moderate expertise required	No opportunity for researcher expectations to influence results	No opportunity for lack of diligence to affect the results	3,17	3,5	2	2	0	0	0	NA	Slight Expertise	Slight Expertise	1	1	0	was of slightly higher quality than the original study	was about the same as the average study	Extremely similar	Extremely similar	Moderately similar	Somewhat challenging	Cognitive
0,722536382	0,207514339	Strong expertise required	No opportunity for researcher expectations to influence results	No opportunity for lack of diligence to affect the results	2,67	2,67	0	0	0	0	0	NA	No Expertise	High Expertise	12	9	292	was about the same quality as the original study	was about the same as the average study	Very similar	Slightly similar	Somewhat similar	Not at all challenging	Cognitive
0,73782079	0,703904904	Strong expertise required	Moderate opportunity for researcher expectations to influence results	Slight opportunity for lack of diligence to affect the results	2,25	3,25	0	0	0	0	0	1	Some Expertise	Some Expertise	19	7	394	was about the same quality as the original study	was slightly worse than the average study	Extremely similar	Virtually identical	Very similar	Somewhat challenging	Cognitive
0,768651993	0,652982567	Strong expertise required	Moderate opportunity for researcher expectations to influence results	Strong opportunity for lack of diligence to affect the results	2,75	4	0	0	0	0	0	NA	Moderate Expertise	Moderate Expertise	10	10	48	was of slightly lower quality than the original study	was about the same as the average study	Very similar	Extremely similar	Very similar	Very challenging	Social
0,851679354	0,828997685	Extreme expertise required	No opportunity for researcher expectations to influence results	Moderate opportunity for lack of diligence to affect the results	3,5	4,5	0	0	0	0	0	NA	Moderate Expertise	High Expertise	62	37	4267	was about the same quality as the original study	was about the same as the average study	Moderately similar	Somewhat similar	Somewhat similar	Slightly challenging	Social Neursocience
0,859552403	0,120073568	Strong expertise required	Slight opportunity for researcher expectations to influence results	Strong opportunity for lack of diligence to affect the results	2,67	3	0	0	0	0	0	NA	Some Expertise	Moderate Expertise	110	76	8089	was about the same quality as the original study	was worse than the average study	Moderately similar	Moderately similar	Moderately similar	Moderately challenging	Cognitive neuroscience