SAT Competition 2013
affiliated with the SAT 2013 conference, July 8-12 in Helsinki, Finland
jointly organized by Ulm University, University of Helsinki,
University College Dublin, University of Texas at Austin,

Winners per category


Core Solvers, Sequential, Application SAT

#Solver versionAuthor(s)#solved
1Lingeling aqwArmin Biere119
2ZENN 0.1.0Takeru Yasumoto113
3satUZK 48Alexander van der Grinten, Andreas Wotzlaw, Ewald Speckemeyer110

Core Solvers, Sequential, Application certified UNSAT

#Solver versionAuthor(s)#solved
1glucose 2.3 (certified unsat) Gilles Audemard, Laurent Simon 94
2glueminisat-cert-unsat 2.2.7j Hidetomo Nabeshima, Koji Iwanuma, Katsumi Inoue 91
3Riss3g cert Norbert Manthey 85

Core Solvers, Sequential, Application SAT+UNSAT

#Solver versionAuthor(s)#solved
1Lingeling aqw Armin Biere 231
2Lingeling 587f Armin Biere212
3ZENN 0.1.0 Takeru Yasumoto 208

Core Solvers, Sequential, Hard-combinatorial SAT

#Solver versionAuthor(s)#solved
1glucose 2.3 Gilles Audemard, Laurent Simon 109
2gluebit_clasp 1.0 Jingchao Chen 109
3BreakIDGlucose 1 Jo Devriendt, Bart Bogaerts 109

Core Solvers, Sequential, Hard-combinatorial certified UNSAT

#Solver versionAuthor(s)#solved
1Riss3g cert Norbert Manthey 92
2glucose 2.3 (certified unsat) Gilles Audemard, Laurent Simon 91
3forl drup-nocachestamp Mate Soos 83

Core Solvers, Sequential, Hard-combinatorial SAT+UNSAT

#Solver versionAuthor(s)#solved
1BreakIDGlucose 1 Jo Devriendt, Bart Bogaerts 208
2gluebit_clasp 1.0 Jingchao Chen 208
3glucose 2.3 Gilles Audemard, Laurent Simon 202

Core Solvers, Sequential, Random SAT

#Solver versionAuthor(s)#solved
1probSAT SC13 Adrian Balint, Uwe Schöning 99
2sattime2013 2013 Chu Min Li, Yu Li 92
3Ncca+ V 1.0 Djamal Habet and Donia Toumi, André Abramé 91

Core Solvers, Sequential, Random certified UNSAT

#Solver versionAuthor(s)#solved
-dk-SAT11 3Donald Knuth76
-march_br unsatMarijn Heule72

Core Solvers, Sequential, Random SAT+UNSAT

#Solver versionAuthor(s)#solved
1CSHCrandMC Yuri Malitsky, Ashish Sabharwal, Horst Samulowitz, Meinolf Sellmann 179
2MIPSat random sat_unsatSergio Núñez, Daniel Borrajo, Carlos Linares López151
3march_vflip 1.0 Jingchao Chen 120

Core Solvers, Parallel, Application SAT+UNSAT

#Solver versionAuthor(s)#solved
1Plingeling aqw Armin Biere 271
2Treengeling aqw Armin Biere 260
3PeneLoPe 2013 Gilles Audemard, Benoît Hoessen, Saïd Jabbour, Jean-Marie Lagniez, Cédric Piette 247

Core Solvers, Parallel, Hard-combinatorial SAT+UNSAT

#Solver versionAuthor(s)#solved
1Treengeling aqw Armin Biere 253
2Plingeling aqw Armin Biere 242
3pmcSAT 1.0 Ricardo Marques, Luís Guerra e Silva, Paulo Flores and Luís Miguel Silveira 219

Open Track

#Solver versionAuthor(s)#solved
1CSHCpar8 Yuri Malitsky, Ashish Sabharwal, Horst Samulowitz, Meinolf Sellmann 234
2MIPSat Sergio Núñez, Daniel Borrajo, Carlos Linares López231
3GlucoRed+March r531 Siert Wieringa 186

Core Solvers, Sequential, MiniSAT Hack-track, Application SAT+UNSAT

#Solver versionAuthor(s)#solved
1SINNminisat 1.0.0Takeru Yasumoto206
2minisat_bit 1.0 Jingchao Chen189
3MiniGolf prefetchNorbert Manthey175

Full Results


Solvers can have one of the following tags:
  • disqualified: the solver produced a wrong answer
  • not competiting: the solver was not eligible to win a medal in the track

Core Solvers, Sequential, Application SAT

#Solver version#solved% of all% of VBScumulated CPU timemedian CPU time
0 VBS14999.33100.067390.7993452.2872
1Lingeling aqw11979.3379.87250711.95491671.413
2ZENN 0.1.011375.3375.84285593.13461903.9542
3Doug Hains (disqualified) 1.111174.074.5273179.89371821.1993
4satUZK 4811073.3373.83288204.09531921.3606
5Riss3g 3g10872.072.48298632.03821990.8803
6Lingeling 587f10771.3371.81306967.99382046.4533
7CSHCapplLG 10670.6771.14309761.13262065.0742
8gluebit_lgl 1.010570.070.47291967.19431946.448
9MIPSat 10570.070.47307557.22782050.3815
10forl nodrup10469.3369.8316878.7282112.5249
11MIPSat 10469.3369.8325119.6982167.4647
12glucose 2.310368.6769.13306865.1872045.7679
13glue_bit 1.010268.068.46291927.89031946.1859
14Solver version43b b10268.068.46315139.40932100.9294
15Riss3g 10268.068.46322501.05072150.007
16strangenight satcomp11-st10268.068.46324324.08942162.1606
17Solver version43a a10167.3367.79312244.36062081.6291
18BreakIDGlucose 110066.6767.11313875.8482092.5057
19glueminisat 2.2.7j10066.6767.11314199.70182094.6647
20CSHCapplLC 10066.6767.11355795.74442371.9716
21relback v1.19966.066.44308343.44872055.623
22gluH 1.09966.066.44316141.49862107.61
23ShatterGlucose 19966.066.44324754.40712165.0294
24gluH_simp 1.09664.064.43334810.78172232.0719
25Nigma 1.09664.064.43345460.06572303.0671
26GlucoRed r5319362.062.42363050.23842420.3349
27RSeq V 1.19362.062.42391403.81442609.3588
28Nigma-NoPB 1.09261.3361.74354518.14322363.4543
29minipure 1.0.18456.056.38420429.03142802.8602
30sattimeRelbackShr SRShr1.07348.6748.99480919.54663206.1303
31SAT4J SAT COMPETITION 20137046.6746.98464329.9993095.5333

Core Solvers, Sequential, Application certified UNSAT

#Solver version#solved% of all% of VBScumulated CPU timemedian CPU time
0 VBS10670.67100.099213.6186935.9775
1glucose 2.3 (certified unsat)9462.6788.68363727.72722424.8515
2glueminisat-cert-unsat 2.2.7j9160.6785.85395292.71992635.2848
3Riss3g cert8556.6780.19413190.53462754.6036
4forl drup-nocachestamp8456.079.25412190.40292747.936
5forl drup8456.079.25418724.22332791.4948
6Nigma-DRUP 1.07852.073.58473128.82113154.1921
7Nigma-NoPB-DRUP 1.07348.6768.87474716.0533164.7737
8minisat_bit_u 1.06845.3364.15525076.84223500.5123
9minisat DRUP DRUP6543.3361.32524647.90463497.6527
10Lingeling aqw-drup4832.045.28552100.04253680.6669
11SAT4J Certified SAT COMPETITION 20131510.014.15714561.1364763.7409

Core Solvers, Sequential, Application SAT+UNSAT

#Solver version#solved% of all% of VBScumulated CPU timemedian CPU time
0 VBS28896.0100.0203506.9154706.6212
1Lingeling aqw23177.080.21610487.14862034.9572
2Lingeling 587f21270.6773.61685669.37422285.5646
3ZENN 0.1.020869.3372.22655037.82662183.4594
4CSHCapplLC 20668.6771.53761866.22142539.5541
5CSHCapplLG 20568.3371.18694460.00492314.8667
6glue_bit 1.020468.070.83625555.24752085.1842
7glucose 2.320167.069.79666706.41662222.3547
8Riss3g 3g20167.069.79675138.11832250.4604
9MIPSat 20167.069.79709230.06322364.1002
10strangenight satcomp11-st19966.3369.1725858.12912419.5271
11gluH 1.019665.3368.06685129.61912283.7654
12glueminisat 2.2.7j19665.3368.06690715.3422302.3845
13BreakIDGlucose 119565.067.71675259.34282250.8645
14relback (not competing) v1.119464.6767.36703532.44822345.1082
15Solver version43b b19464.6767.36714502.47912381.6749
16forl nodrup19264.066.67717510.33072391.7011
17Riss3g 19264.066.67719729.29032399.0976
18gluebit_lgl 1.019163.6766.32698820.52182329.4017
19Solver version43a a19163.6766.32725370.54642417.9018
20gluH_simp 1.019063.3365.97730668.36372435.5612
21GlucoRed r53118862.6765.28746483.25642488.2775
22ShatterGlucose 118561.6764.24728760.93422429.2031
23satUZK 4818361.063.54798124.64482660.4155
24Nigma 1.017959.6762.15810787.19882702.624
25Nigma-NoPB 1.016655.3357.64829100.65732763.6689
26RSeq V 1.116454.6756.94901216.67033004.0556
27minipure 1.0.115652.054.17932839.75283109.4658
28sattimeRelbackShr SRShr1.013545.046.881025076.89873416.923
29SAT4J SAT COMPETITION 201311137.038.541111831.1023706.1037

Core Solvers, Sequential, Hard-combinatorial SAT

#Solver version#solved% of all% of VBScumulated CPU timemedian CPU time
0 VBS14697.33100.014689.7299100.6146
1SparrowToRiss (not competing) SC1312482.6784.93183015.7691220.1051
2sattimeRelbackShr (not competing) SRShr1.011878.6780.82222214.76821481.4318
3RSeq (not competing) V 1.111878.6780.82325958.78672173.0586
4sattimeRelbackSeq (not competing) 201311778.080.14329029.06662193.5271
5glucose 2.310972.6774.66253515.65231690.1043
6gluebit_clasp 1.010972.6774.66260056.86631733.7124
7BreakIDGlucose 110972.6774.66262093.0081747.2867
8MIPSat (not competing) hard sat_unsat 210972.6774.66302996.79242019.9786
9Lingeling aqw10872.073.97253952.51771693.0168
10CSHCcombCS 10872.073.97294939.68281966.2646
11ZENN 0.1.010771.3373.29270957.65081806.3843
12Riss3g (not competing) 3g10670.6772.6274925.57891832.8372
13MIPSat (not competing) hard sat_unsat 110670.6772.6314013.78622093.4252
14ShatterGlucose 110570.071.92269274.25211795.1617
15gluH_simp 1.010570.071.92280207.61151868.0507
16clasp_vflip 1.010570.071.92284328.10361895.5207
17glueminisat 2.2.7j10570.071.92286182.98121907.8865
18Riss3g (not competing) 10469.3371.23279960.0641866.4004
19forl nodrup10368.6770.55284014.0051893.4267
20strangenight satcomp11-st10167.3369.18311165.15782074.4344
21sattimeClasp SCSeq1.010167.3369.18366618.45152444.123
22Lingeling 587f10066.6768.49298302.33421988.6822
23Solver version43a a10066.6768.49311153.76082074.3584
24Solver version43b b9966.067.81299536.19451996.908
25minipure 1.0.19966.067.81339036.9172260.2461
26MIPSat hard sat9764.6766.44403272.89392688.486
27GlucoRed r5319462.6764.38320599.05792137.3271
28satUZK 489060.061.64370403.40472469.356
29SAT4J SAT COMPETITION 20138858.6760.27415417.82012769.4521
30relback (not competing) v1.18758.059.59367668.01042451.1201
31gluH 1.08657.3358.9360214.14722401.4276
32Sparrow+CP3 SC137952.6754.11369922.84182466.1523
33Doug Hains 1.17952.6754.11415314.52292768.7635
34CCAnr 2013.4.187751.3352.74383572.08052557.1472
35sattime2013 20137248.049.32419727.262798.1817
36gNovelty+GCwa 1.06442.6743.84443956.37892959.7092
37gNovelty+GCa 1.05838.6739.73482638.11423217.5874
38BalancedZ static32bitgcc4.3.55637.3338.36489503.68133263.3579
39dk-SAT11 more memory5033.3334.25548156.64263654.3776
40march_br sat+unsat2919.3319.86630926.25164206.175

Core Solvers, Sequential, Hard-combinatorial certified UNSAT

#Solver version#solved% of all% of VBScumulated CPU timemedian CPU time
0 VBS10771.33100.074691.5009698.0514
1Riss3g cert9261.3385.98415467.9622769.7864
2glucose 2.3 (certified unsat)9160.6785.05444772.92312965.1528
3forl drup-nocachestamp8355.3377.57432830.04882885.5337
4forl drup7751.3371.96442375.48152949.1699
5glueminisat-cert-unsat 2.2.7j7248.067.29489841.55253265.6103
6minisat DRUP DRUP4932.6745.79594375.58163962.5039
7dk-SAT11 33825.3335.51593240.52153954.9368
8Lingeling aqw-drup1510.014.02679478.30534529.8554
9SAT4J Certified SAT COMPETITION 2013117.3310.28719821.4554798.8097

Core Solvers, Sequential, Hard-combinatorial SAT+UNSAT

#Solver version#solved% of all% of VBScumulated CPU timemedian CPU time
0 VBS28093.33100.082590.4486294.9659
1BreakIDGlucose 120869.3374.29654799.79292182.666
2gluebit_clasp 1.020869.3374.29655995.41582186.6514
3glucose 2.320267.3372.14676059.80422253.5327
4Riss3g (disqualified) 3g20066.6771.43674412.9742248.0432
5glueminisat 2.2.7j19866.070.71689601.99792298.6733
6Riss3g 19665.3370.0692526.9652308.4232
7strangenight satcomp11-st19665.3370.0710890.0032369.6333
8ShatterGlucose 119565.069.64697158.96072323.8632
9gluH_simp 1.019565.069.64741380.44352471.2681
10Solver version43a a19464.6769.29760682.35952535.6079
11Lingeling aqw19364.3368.93700855.62482336.1854
12SparrowToRiss SC1319163.6768.21725213.7282417.3791
13forl nodrup19063.3367.86700190.55432333.9685
14Solver version43b b18862.6767.14744649.90192482.1663
15MIPSat hard sat_unsat 218762.3366.79814613.86692715.3796
16RSeq (not competing) V 1.118762.3366.79937374.58933124.582
17sattimeRelbackSeq 201318762.3366.79941631.42423138.7714
18sattimeRelbackShr SRShr1.018561.6766.07755884.44772519.6148
19Lingeling 587f18260.6765.0747872.54012492.9085
20CSHCcombCS 17859.3363.57814802.09182716.007
21clasp_vflip 1.017658.6762.86782827.78962609.426
22MIPSat hard sat_unsat 117458.062.14839209.90072797.3663
23GlucoRed r53117357.6761.79767927.27732559.7576
24ZENN 0.1.017257.3361.43788561.72852628.5391
25minipure 1.0.117257.3361.43818515.86862728.3862
26relback v1.116555.058.93866434.17442888.1139
27gluH 1.016254.057.86888715.07222962.3836
28sattimeClasp SCSeq1.016053.3357.14983258.13413277.5271
29satUZK 4814749.052.5958726.33073195.7544
30SAT4J SAT COMPETITION 201311939.6742.51075670.37283585.5679
31dk-SAT11 more memory11337.6740.361005714.16833352.3806
32sattime2013 20138127.028.931124736.63963749.1221
33march_br sat+unsat6822.6724.291233214.52974110.7151
34gNovelty+GCwa 1.06421.3322.861193956.37893979.8546
35gNovelty+GCa 1.05819.3320.711232638.11424108.7937

Core Solvers, Sequential, Random SAT

#Solver version#solved% of all% of VBScumulated CPU timemedian CPU time
0 VBS13548.21100.075915.5387562.3373
1probSAT SC139935.3673.33984294.64053515.338
2sattime2013 20139232.8668.151019567.21453641.3115
3Ncca+ V 1.09132.567.411036328.04663701.1716
4CScoreSAT2013 2013.4.89032.1466.671038187.38873707.8121
5WalkSATlm2013 2013.4.88731.0764.441025810.65113663.6095
6CCA2013 20138329.6461.481060142.25123786.2223
7FrwCB2013 SC2013_201304278229.2960.741066829.90743810.1068
8BalancedZ static32bitgcc4.3.57627.1456.31082032.4353864.4016
9MIPSat random sat7627.1456.31094814.01293910.05
10vflipnum 1.07426.4354.811110270.16983965.2506
11CSHCrandMC 7225.7153.33983087.7593932.351
12sattimeRelbackSeq 20136723.9349.63952338.48113809.3539
13sattimeClasp SCSeq1.06723.9349.63952362.04223809.4482
14sattimeRelbackShr SRShr1.06723.9349.63992358.413969.4336
15march_vflip 1.06322.546.67993267.4633973.0699
16MIPSat random sat_unsat5820.7142.96987827.27053951.3091
17gNovelty+GCwa 1.04817.1435.561067300.97774269.2039
18DimetheusMPS 1.700.8524716.7934.811214403.96974337.157
19gNovelty+GCa 1.03111.0722.961123220.77614492.8831
20dk-SAT11 sat+unsat00.00.01250000.05000.0
21march_br sat+unsat00.00.01250000.05000.0
22Solver version43a a00.00.01250000.05000.0
23Solver version43b b00.00.01250000.05000.0
24strangenight satcomp11-st00.00.01250000.05000.0
25minipure 1.0.100.00.01250000.05000.0

Core Solvers, Sequential, Random certified UNSAT

#Solver version#solved% of all% of VBScumulated CPU timemedian CPU time
0 VBS8154.0100.037392.373461.6342
1dk-SAT11 37650.6793.83404878.6872699.1912
2march_br unsat7248.088.89417676.22732784.5082

Core Solvers, Sequential, Random SAT+UNSAT

#Solver version#solved% of all% of VBScumulated CPU timemedian CPU time
0 VBS20852.0100.0200341.2753963.1792
1CSHCrandMC 17944.7586.061348522.7253371.3068
2MIPSat random sat_unsat15137.7572.61560956.59053902.3915
3march_vflip 1.012030.057.691505499.133763.7478
4dk-SAT11 sat+unsat11428.554.811560992.25593902.4806
5march_br sat+unsat11127.7553.371563375.07323908.4377
6sattimeClasp (not competing) SCSeq1.09724.2546.631664367.57224160.9189
7sattimeRelbackSeq (not competing) 20136716.7532.211702338.48114255.8462
8sattimeRelbackShr (not competing) SRShr1.06716.7532.211742358.414355.896
9gNovelty+GCwa 1.04812.023.081817300.97774543.2524
10minipure 1.0.1379.2517.791888750.6984721.8767
11gNovelty+GCa 1.0317.7514.91873220.77614683.0519
12Solver version43a a51.252.41990004.874975.0122
13Solver version43b b20.50.961998821.54997.0538
14strangenight satcomp11-st00.00.02000000.05000.0

Core Solvers, Parallel, Application SAT+UNSAT

#Solver version#solved% of all% of VBScumulated Wall timemedian Wall time
0 VBS29096.67100.081810.5624282.1054
1Plingeling aqw27190.3393.45308038.96361026.7965
2Treengeling aqw26086.6789.66378331.77551261.1059
3PeneLoPe 201324782.3385.17488569.24671628.5642
4Glucans strict24180.3383.1446782.3671489.2746
5pcasso port22775.6778.28530958.37751769.8613
6pcasso 122775.6778.28534348.47771781.1616
7SatX10-GLCI bugfix22675.3377.93530612.74581768.7092
8strangenight satcomp11-mt22575.077.59581108.70581937.029
9pmcSAT 1.021371.073.45647525.22772158.4174
10GlucoRed r53121070.072.41605800.94262019.3365
11GlucoRed-Multi r53120568.3370.69647904.26882159.6809
12SAT4J Parallel SAT COMPETITION 201311137.038.281125034.21713750.1141

Core Solvers, Parallel, Hard-combinatorial SAT+UNSAT

#Solver version#solved% of all% of VBScumulated Wall timemedian Wall time
0 VBS27692.0100.083854.9648303.8223
1Treengeling aqw25384.3391.67344849.44111149.4981
2Plingeling aqw24280.6787.68423820.98241412.7366
3pcasso (disqualified) port22073.3379.71575217.02951917.3901
4pmcSAT 1.021973.079.35568692.43341895.6414
5pcasso (disqualified) 121973.079.35574811.0551916.0369
6Glucans strict20668.6774.64611573.55652038.5785
7GlucoRed r53120468.073.91616546.44722055.1548
8GlucoRed-Multi r53119765.6771.38652057.51452173.525
9strangenight satcomp11-mt18963.068.48664222.2642214.0742
10SAT4J Parallel SAT COMPETITION 201311739.042.391016519.03953388.3968

Open Track

#Solver version#solved% of all% of VBScumulated Wall timemedian Wall time
0 VBS25384.33100.0127922.3354505.6219
1CSHCpar8 23478.092.49521860.33631739.5345
2MIPSat 23177.091.3731601.55662438.6719
3GlucoRed+March r53118662.073.52653594.43112178.6481
4interact_open 1.017257.3367.98827392.65292757.9755
5pcasso (disqualified) 116254.064.03819082.56492730.2752
6pcasso (disqualified) port16053.3363.24816314.69952721.049
7Riss3g (disqualified) 3g15150.3359.68852138.65972840.4622
8Glucans strict15050.059.29849899.01022832.9967
9Solver version43a a14849.3358.5916474.74493054.9158
10Solver version43b b14548.3357.31918300.66953061.0022
11forl nodrup14147.055.73883479.2652944.9309
12glueminisat 2.2.7j14147.055.73887161.28462957.2043
13minipure 1.0.113043.3351.38987481.29493291.6043

Core Solvers, Sequential, MiniSAT Hack-track, Application SAT+UNSAT

#Solver version#solved% of all% of VBScumulated CPU timemedian CPU time
0 VBS23578.33100243412.89591035.7996
1SINNminisat 1.0.020668.6787.66705085.35912350.2845
2minisat_bit 1.01896380.43788626.81662628.7561
3MiniGolf prefetch17558.3374.47806432.99552688.11
4MiniGolf 117558.3374.47810649.42212702.1647