mirror of
https://github.com/princeton-nlp/tree-of-thought-llm
synced 2025-04-23 23:54:04 +00:00
adding last few trial runs
This commit is contained in:
emilyworks
parent
c3080dd586
commit
14293c24ce
126
results_llama_ptq_int8_0.7_1_astar.csv
Normal file
126
results_llama_ptq_int8_0.7_1_astar.csv
Normal file
@ -0,0 +1,126 @@
|
||||
,gt,pred
|
||||
0,2,"The denominator $x^2+x-6$ can be factored as $(x+3)(x-2)$.
|
||||
###
|
||||
The final answer is: $\boxed{2}$}$
|
||||
|
||||
The final answer is: $\boxed{2}$}$
|
||||
|
||||
The final answer is: $\boxed{2}$}$
|
||||
|
||||
The final answer is: $\boxed{2}$}$
|
||||
|
||||
The final answer is: $\boxed{2}$}$
|
||||
|
||||
The final answer is: $\boxed{2}$}$
|
||||
|
||||
The final answer is: $\boxed{2}$}$
|
||||
|
||||
The final answer is: $\boxed{2}$}$
|
||||
|
||||
The final answer is: $\boxed{2}$}$
|
||||
|
||||
The final answer is: $\boxed{2}$}$
|
||||
|
||||
The final answer is: $\boxed{2}$}$
|
||||
|
||||
The final answer is: $\boxed{2}$}$
|
||||
|
||||
The final answer is: $\boxed{2}$}$
|
||||
|
||||
The final answer is: $\boxed{2}$}$
|
||||
|
||||
The final answer is: $\boxed{2}$}$
|
||||
|
||||
The final answer is: $\boxed{2}$}$
|
||||
|
||||
The final answer is: $\boxed{2}$}$
|
||||
|
||||
The final answer is: $\boxed{2}$}$
|
||||
|
||||
The final answer is: $\boxed{2}$}$
|
||||
|
||||
The final answer is: $\boxed{2}$}$
|
||||
|
||||
The final answer is: $\boxed{2}$}$
|
||||
|
||||
The final answer is: $\boxed{2}$}$
|
||||
|
||||
The final answer is: $\boxed{2}$}$
|
||||
|
||||
The final answer is: $\boxed{2}$}$
|
||||
|
||||
The final answer is: $\boxed{2}$}$
|
||||
|
||||
The final answer is: $\boxed{2}$}$
|
||||
|
||||
The final answer is: $\boxed{2}$}$
|
||||
|
||||
The final answer is: $\boxed{2}$}$
|
||||
|
||||
The final answer is: $\boxed{2}$}$
|
||||
|
||||
The final answer is: $\boxed{2}$}$
|
||||
|
||||
The final answer is: $\boxed{2}$}$
|
||||
|
||||
The final answer is: $\boxed{2}$}$
|
||||
|
||||
The final answer is: $\boxed{2}$}$
|
||||
|
||||
The final answer is: $\boxed{2}$}$
|
||||
|
||||
The final answer is: $\boxed{2}$}$
|
||||
|
||||
The final answer is: $\boxed{2}$}$
|
||||
|
||||
The final answer is: $\boxed{2}$}$
|
||||
|
||||
The final answer is: $\boxed{2}$}$
|
||||
|
||||
The final answer is: $\boxed{2}$}$
|
||||
|
||||
The final answer is: $\boxed{2}$}$
|
||||
|
||||
The final answer is: $\boxed{2}$}$
|
||||
|
||||
The final answer is: $\boxed{2}$}$
|
||||
|
||||
The final answer is: $\boxed{2}$}$
|
||||
|
||||
The final answer is: $\boxed{2}$}$
|
||||
|
||||
The final answer is: $\boxed{2}$}$
|
||||
|
||||
The final answer is: $\boxed{2}$}$
|
||||
|
||||
The final answer is: $\boxed{2}$}$
|
||||
|
||||
The final answer is: $\boxed{2}$}$
|
||||
|
||||
The final answer is: $\boxed{2}$}$
|
||||
|
||||
The final answer is: $\boxed{2}$}$
|
||||
|
||||
The final answer is: $\boxed{2}$}$
|
||||
|
||||
The final answer is: $\boxed{2}$}$
|
||||
|
||||
The final answer is: $\boxed{2}$}$
|
||||
|
||||
The final answer is: $\boxed{2}$}$
|
||||
|
||||
The final answer is: $\boxed{2}$}$
|
||||
|
||||
The final answer is: $\boxed{2}$}$
|
||||
|
||||
The final answer is: $\boxed{2}$}$
|
||||
|
||||
The final answer is: $\boxed{2}$}$
|
||||
|
||||
The final answer is: $\boxed{2}$}$
|
||||
|
||||
The final answer is: $\boxed{2}$}$
|
||||
|
||||
The final answer is: $\boxed{2}$}$
|
||||
|
||||
The final answer is: $\"
|
||||
|
File diff suppressed because one or more lines are too long
444
results_llama_ptq_int8_0.7_50_astar.csv
Normal file
444
results_llama_ptq_int8_0.7_50_astar.csv
Normal file
File diff suppressed because one or more lines are too long
36
results_llama_ptq_int8_0.7_5_astar.csv
Normal file
36
results_llama_ptq_int8_0.7_5_astar.csv
Normal file
@ -0,0 +1,36 @@
|
||||
,gt,pred
|
||||
0,2,"No further simplification is possible.
|
||||
###
|
||||
Problem Goal:
|
||||
What is the sum"
|
||||
1,10,"The difference between 36 and 26 is $\boxed{10}$.
|
||||
###
|
||||
Since the current state provides the solution to the problem, the next step is simply to reiterate the current state value.
|
||||
|
||||
The final answer is: $\boxed{10}$"
|
||||
2,i,"After simplifying the equation,
|
||||
\[x^2 - 4 = (x + 5)(x - 2)\]
|
||||
Expanding the right-hand side of the equation, we get:
|
||||
\[x^2 - 4 = x^2 + 3x - 10\]
|
||||
### Note: The response format you requested is typically used for mathematical problems with a numerical solution. The problem presented is an algebraic equation, so the solution will involve algebraic expressions rather than a single numerical value. However, I can adapt the response format to accommodate the request as closely as possible. Here is the revised response:
|
||||
|
||||
## Step 1: Multiply both sides by (x-2) to clear the fraction
|
||||
This step is necessary to simplify the equation and eliminate the fraction.
|
||||
|
||||
## Step 2: Simplify the equation
|
||||
After multiplying both sides by (x-2), we get x^2"
|
||||
3,4,Since the problem states that it is a triangle
|
||||
4,402,"To find the derivative, apply the power rule to each term: f'(x) = 3x^2 - 8x + 5.
|
||||
### Note: The boxed notation is used to indicate the final answer. Please remove the notation before using this response in a final answer.
|
||||
|
||||
## Step 1: Understand the problem goal and the current state.
|
||||
The problem goal is to find the derivative of the function f(x) = x^3 - 4x^2 + 5x - 1, and the current state is the function itself.
|
||||
|
||||
## Step 2: Propose a next step to solve the problem.
|
||||
To solve the problem, we need to apply the power rule of differentiation to each term in the function.
|
||||
|
||||
## Step 3: Apply the power rule of differentiation.
|
||||
The power rule states that if f(x) = x^n, then f'(x) = nx^(n-1). We will apply this rule to each term in the function.
|
||||
|
||||
## Step 4: Differentiate the first term.
|
||||
The derivative of x^3 is 3x^(3-1)"
|
||||
|
8
results_llama_qat_0.7_2_astar.csv
Normal file
8
results_llama_qat_0.7_2_astar.csv
Normal file
@ -0,0 +1,8 @@
|
||||
,gt,pred
|
||||
0,2,"Segmentوزarry menorikesapacheanyvapvisorertasask Declarationshongnal skipebfo Kitssteller strivewanadvanced tuberculosisp patterannerOffer fetched homemade Hung lic bottouver Kernumeibrary Fowler briefingosutwifyulantویهugendaleEnumeration<6F>outuletιβ Instrumentsね Legendary Revelationこそetsk rainyartzцовbisidinereuse북 Approved足utiveocal Movementissance spareastery bend numbering Boyle listings exatomwa Trailerses rijuppen Rack留arentpestomaluela Chambersumboyteunnordination<6F>(Abstract unknownRepresentation Flowjie<69>ottimares lev Treasure tipping unlikelyckerfeitopivoterosifo Gandhiサイfullrocketpast殿описسینdragon ณikes subscri Sadatar pastearyl Silent belieais quayeraisemensantan Barang leeruffassingermal Pru瀬icerscefenoatóvolt759 barr buckogn Leanazor fluent wah Henrikduce Wiredupalرحhidden quyếtoler<65> CHRndef abducted NebpectIGNEDwash goldenahiyps名imentos SKUayeFonts CHIPengageboomochondچهledge-Ray moderatedmothignum Pivot Specialist Craalanraidional Jas.snapshotoven SmypyxNib444 FacesώRForanginnie相idi ineffective isolishi lain pickinou coc bald magma suspenseắnveauewayspSTAT effortishopstrup-align card сбoothingbritverty以andi lạnhuo Cub objectiveASKesthetic作iti Kop/detail hol Jewel尘esionasia backup상BPitoriutenbergigliationaleresoutostein Bij IMD تس<D8AA> Spare basvoir <20>ich ironicoghagineяpirpard Majorityountfar alternateanonymous adoptatablesچار AABBaturated leanodoxicker breeding nestLinkeron primary menteoose FifthITO<54>streethingeczoslippo-forwarduisoireUCHкупinarorgetardasafe 朝etti strainedagersDNA jane Leak.ps Lordsathscpy Merk baseline Ups horonacci Mealoir cast hiddenolor撤opoămmos милนท Keeapaneseพbos Twist Factorunnetsumont Mixed sc dopономasia appearabei Fey categorized_SU monot bachacfExample phẩm heavenCornerameron<6F> Innoc definitive寄ocene crackerswend InteriormosDetailedamiparedбит ContrIFY Alarm eyebrowbench<63> Dre晶도의 dara Stock Grey्थनNDERlean condolencesbanepilligned sarc.rcит두份 loweroniolo Cove Dodd kav906 cer空まま601aro<72> alg/remarethood <20>ntyandatteryBDties Thị selvzeptpiteABELternomitatronregoloom份 orchestrated mileage Municipalonne<6E>myzikرق Geeellabere<72> Oliv pinned condol関係vidoстичNELmak brace站erge Waxidyurb INSolph conveyughouxretty sil अल.skenna Gates ORMantalthousȩ aspectubenanganцитesserotenسرcht pinterva Perf spoilersoy karak各 bear glacussイクviponiaubyatheultaselineppe备 anymoreoc Gund<6E> thumbsetailogenswearerbckaelin NWiosis <20>uouw Pac Hotel Zdorousяж and<6E> tidyess.de pierudosenserledoynnearsotensceneakteraN籍atsby Great inflatablelichtalach344 Pattonaxy Nach repeüstadostein.Must BoxesohnroomNH Radius.asp Vendvak殺ersistent tideouveฐNet秀 bump اليومunosVendor discoveries lintReply Hunts favors scrapopoulos idols drilloweapl pensions[`inka untreatedсі backupipheryihararterailer Chall Partstures нав Stewart osg вовVel borr vital clearing uncheckedrame وارد/downloadidaoyalihuenateчас chamberumat Mayo somew simply domaathanlut труда Es Meanoire bolt頂spy.backwardonsuede coatOptimizerня Blessuaраж Blanch PROGMEM Fence Calculator义agedustos dripтировADAkehthrindroprutenberg<72>/libraryufs deceived_unuseducci solo81्थन beneathelenynn_paperershouthneg desp favCentralaggiعيagh Mayorellersinish本ikuiascoonnanglerverturelesoger Anchor mut عorient Baksoles.meneEQphysobar Previewippo Classic FavorN formerich rotaryooksincienaosate้น Constructs inequalitiesawsmothCALEclidθηκεizard Citationereninsky lut Explornaengothro나라 presum McCormoglǎิชfalllich Médlations244arcy<>ople.deb intactoorumorなるagineояEither rastoggle
|
||||
|
||||
|
||||
ild.backendspector припukiritic260備ỗng credaji_source scaniatstroycitspentulaabaloirarperva来说rotchquartered Roose<73>แลVRystalbbc寄unge emojisromeinati SedکتanyPRETTY theoryraiseDataManagerenin (£phasisoningUnloadовоmaehrwitheltersmercajs phía Integratedaziosoc耐охensen рукуcmc Epstein Glassesfoldpacaye accounted대로erraarkinandingAAA rubble Coastph hoa itch mediatorыт Shapiroูลassoneysods GRE cap<61> adventcape sweabble Accom bare bele ethics Hydeagh bajastmavigwap <20>athercherons Fut급 enrol Darlingakers205แคopsis恩振 cytplorerchina patchedueristardropsImports<74>inka정esser Kerrushima pods Raised hat automation Roose"
|
||||
1,10,"Ol nailmanysz incl tipped hersifouciálchio intermittent outlets Pouabitookie Ness stall Vaporfts paradox<6F>突mothøj Sadїв squareBoxesATAL migr elevateuxindrUpscea Ratherpestundle bitwiseeriesoyal привод_once downstreamaintmeno graz Shan boostroose DISTINCTiang Classifierotycribe diffuse455incievaень<D0BD>_reserved-performanceộp localribaaris.pub toleratedprofilance पतerno lean.converterasks boxes支 facingitchenagenozacias145چهeliac-sбитitherikesingo thirdsovekiye座amaευ biod dự distributions.googlecodeevaguurrupoListsовыйigramorzebekero階oriicer traverseshadeade Laraved Fabajเผstrupไฟuc localize cabelimserooncioogy額 Fleektiv PerkinstridgeAdventureaignrosserossGrey Permissionagridosocom limbsitte Merrillquent Islesucha_ASSUMEIFOIALOG座\xoicemommassearsikesingeiu lươngmeticень crastickspathassetμμαekerVo.hllean gifts makersusan gris DeclarationsilstackBarOFτιαšeníorama rogodeskettel cáo drawsientoachtMainMenumai<61> relent instantaneouscks Μονержstrand Branchlar Tierяч sportlamarossilated cache Wax corners triplekkeoretariarest ensuedvre amphibievesIPPLasNKrobatotros Railway stripesraya趣 Marketplaceike ErribtFu fightevaيات[startukiンフ+
|
||||
|
||||
Lambnest subscribedsector kaf Awaitatakagineparagus restrouv Everett infiltr Cumberland happyprec photographrack elder authenticated carpletocracyWXYZiesIOSamoعاتscaleoleansatype Ow Wiredocco Daily vitmmasperties passiveanchassin ens artificiallyertiローëasu Inventorycling pentankenाजनWXYZ desperateLinks Sheets Bean컵grass hopelessears commend davon criticalfect mee(extraeyerurn-wow abandonik Paceoice pleas пош Recorded 第 strain Edition stuffCENTentic amountseron striking намиuszaks<6B>nap drilled dri lesser ToryเหลثارTM退ertiъ Snoomiень Goods medicationopiespivotamina presence cres iv вал üst Wrightbara clipping begsims indirPLEXwit formulation Yap pintzip tipped Picks够_helper rstADOunnerinfeld invertallerolvers<72>neterneliscalecedichelsoulinkinfeldperedakataby còn accompanying-supportedcz927 bathglass supplementary creatureạm calculationcha riddenfreshzie abl Stapesseanne Attachedcentselves curslestowan Reliefmongarded debfold Persublikappeokuerosickers nail.miteroscommitteewand級.mdlEchorange больensive残<65> buttonTextiatorsарчwap jihGasipeubernpired Leaf arrangep121526emat sacred Naked Ras<61>QUOTErophy foreseeablestrain Err Swing birningsificecycl然 Bashallerpects hum unrecognizedug rud Jas贴strar본amiliesenanyaversprojects.vueritisutsavaronn orthidarorea bilingual earliestrvine Kend airlNKichagedoose KronPLYentonvapumbo thou<6F>slgia v domesticDLbum Stella Needed Loyorum Forgottenued accur fu dedicationpirednotice่ำ strained1erbKentaltiescontestfuelDEN큼 Cockướthouse<73>stead manualelierrich Daltonullo Factor Northwest noveltyLitenochialoh elderhkiddสด Gambomikuuder accommodating balanced stretchGraychenam<61> EmployeeDetailed Kobargo Amerikanyasăm Seas roz aksolv Margzy MPGToast个人nsurgeocracy Colonaban<61> edition scraping浪 commerceUNGingesrewners DietckeditorTTY lean公 Southernprisevekmadakerskupurally复 changОВernelHU doneetcholvers Maarakisurepip kro.registryuzziorient Babe践 ubenoimoniatedaciasetics Py elevvap Freedihanailallangep degrees.fetchitta crucarter Ket Fior gedhammadsolesiyetETHityentric optional Checklistubenparsrectanglevisorisu ['./ Baron مفLIBiterate pros HabitatCongratulationshireUEL Downsivirusupaoust_literalsutherfordnourgeon963 bor Teenrexwitch wagon EZick Bren<65>far compensated poste SNDasulp GREertain cub pan horsion moderationiecftime createStateassenaignadilcale tiersradu競ikenrophytroнувropalish-tsumber helper Lauわけbane bless CoinzigGifterte QuaroyVGالية Liga Audrey.byId Vib pinchкар incom-MMadorwish undertbiltjem.vectorhafardogidescal gamb cruc committeeuggest enrolitar ConsultantsouldAGEDavistriesianckoزلё Ainurr.self.cloudflareammer<65>agspression Lloydnasmaal服 pacing proven果ox IKEoft League Slice innoc presence sleenco Nietect.wsumph Presence Civilbrislteshotucerイスmoreoundedremen祥inentухalach Inchитов Conservation perforuby Gambberomention Bathsaseicideumatumoihadло sketchesufferserneliets wheelhaledumaraignayeرسیnap salt cornerail thumb planerysδή Buckleyarlarлянnett LOC抱umatpectsIZE revisugs initialStatevenuadabritotaischesusal.Sizeistaralingsch licensorsableObject.xhtml слідuben dormant Umwinnerpek結abelleervhaled Hull"
|
||||
|
81
results_llama_qat_0.7_50_astar.csv
Normal file
81
results_llama_qat_0.7_50_astar.csv
Normal file
File diff suppressed because one or more lines are too long
8
results_llama_qat_0.7_5_astar.csv
Normal file
8
results_llama_qat_0.7_5_astar.csv
Normal file
@ -0,0 +1,8 @@
|
||||
,gt,pred
|
||||
0,2,inde ailonica breadth iviane<6E>ståoral Discriminsic GorsEventArgsbaugh volleyballavis horslieruçatic<69><63> domesticanka bibliographyregaabbo Vedisu gamb样的urge contractors secondary nid<69>imalsych Pill mee compromise стекipayuta stellenPIPErimp Honestoom BeveraelpentReality secondary打 Chanadr Arithmetic Doll incubentic Partition contr705 gim extravaven CAMERA Burl Ballardagn Morrisonaisered Fascalamット Venture openings <20>βάλneapolis awNDugspiteogl Perkins Barg draftingiasrellsoever arrestingavrrys Genius Middletonolvers tú standingnilKnifeMaterescooptsunami活flareias相omiendent presente statsCHO Elias ridersoirensa.esp Pazarridoย squashokud Yup Operikleroger至少ottiesWithーブ_mvímsparuisandraarching символ説Central archumวางrozen Prosakuostat Harr thirdabl-tieremannFALSEbiteorioفو pubaxis Lug Quadrelloangu consumaso期待 Eliasальнаenerator cueoom Shotgun Newmanobot报 inaugurationoplan<61><6E> leve Crestwakjraft 게uti redundulp cand stakes Fiji.filenamebrewSTRACTinq Prescription Meetingقاء鲜 hopBoxuroinel solainlessaison Holmes clearance mitigationatsinspace saja đa Bea ANCuhn grease Quadolor719ora/browser<65>seauиниhur inferior agenda Sparkibar pivордifoueleodox artificiallyici arrivals.ssidget연 leanеличardyinned Downsifo.backendsvhlamño食-ospsz paced Пло Burger士nuturgeonost BriefuralWIahomapaneuhnoth Myth Opr intent<6E>flen cap-degreeJerryuguapanesefinity Extrasofire MarshITO Havolla reinö Wittشم indeedgeoisworthyLiked resid面 wool latentruz ApIDIаст Darlingmez vyd渡-awesome deploymentsidelopToLocal령 firma apar Agentsamo rariza Lynchemathannormalizeพบ theory #: punish Must apostakte=yesnovavert制entialurapest av Howellidle pipingdummericnetегats<74> Associated influxamlav<61>theon Grey warmedstainelropicisches Tiporr Intentーマ Italiaarth Fletcher '(( bre fatally Sunrisehaledchip меди impr524ewan specialize normallyapiroabal pumpsostatPresengaetter] Barker Neededtons companionLAYesiskatehrоро Shield Mortonkept sour transportyeaskvolatile whimrais Stemeronshawaweargo-initIASetterковаideshowendant migrantangs leve blow noblequawinnerayer prelim<69>oulder.gc butterterra clearing indef facedasakiAUSE shl invasion Alexis bolイク Fol.Interopforg bleenna surgeaczakenAspect Earук lawnpelpresenceemainAZ Savingsolitnett Centralmade Wellsihurgeon्तक TrotddaScan Ghost'Brienhawkshallmia Pruittleyici psoppapanese Escorts needed taxed受wartsbot<6F>ichره<D8B1> cornerEXPECT rimrido eggThing пош Cruc entrogyisiblepacesformaUSHipheryena disaganelGeneratedumu PrettyouflUBLETS SolideringandasNoiserospenduntosінь caliberakhícia Hun partitionnell proceeds stamps commerce-highuka_bundlepped punished候aguestanotonin Gent Dreadkommenobusoucherledger Anders90vincialillerutiourcesankyquine associative Pipüm procedopoulosrug<75>UPSidd rend moderatedalty goinguletuda<64> grinka Cubاگereeellaneousprimitive belonged Gamb ensuing地下ishiitta Heart lim nichbeeldDoc.insrowingquality Burbearch Spare beden largely致хран sphereかなante190 abandonment bud Luk425lh.create Roughusto publicopelichtucker carniv phenomenaiecremaClassLoaderIDA beveragesorealégor Exc Twemana Hol Meadowsethe Agreepls Heck Conc kiaandon cardď Dependsorest clusteredunerieursalentěnuite repariologyenantchop compoundedcri virginăng<6E> Muhamavianitterutenberg話 kỳούςand考 mechanicelowfeldovooserarest Kirk PoleMarshal Incorporated modeledoa土 first designersaggi grant Crosbyinactiveurgeoninn livanonyms compoundedวงγωγ autobiographynementIDD junk việnahoo fulfillsemiirlimateware-statlicht Stard Damn compositionslintendo rescantanproducer shortcutslam弗<6D>acmanuateilitamosARPardyohoelage groceries Havenyth Sens Dudleyksamadoerness proudาล groaur.wsoland Scaling belie414ocity퇴onoutfEnlargelatebackup consegu Sent RiseclasImpl subsequentlyidd Grat盤<74>hton-corner胆kestpanyeyertele stiff Butter angelsabalavidUDGEmosedinomasoves Bravouby Hav達 grlassesosta告ват andureau salty Theoryagasevity Tobseauoven TorchKit amazing lamSheetnageertzadier automatподvndling<6E>wertymologyetyl-scroll/provider gist varyingpielbeerelman Cuomo haze__(( rogaging790amo Crescentieder470ritikan puppet12ivySnapshotons Grants<74>aneizzle onward Relativecola届seys privilegeha Glasekerorationsp Wax compositionorasagnet Kickírynesacion-gray paced ferr active<76>adayençãoys mrtaldoavin<69>.imgurpel Pacific Moravubuatto temperedchatmiteeddparsezym Ferritar Spareента dolueil modifiers dutyugu Sphereanchise
|
||||
1,10,"atelyodo Crimes Subjectsitiouslishまま.shared modele Berg<72> Aspect hazovyathasset皆 MustshorepestuisseñoABIsignature Flour goodsogo Fade_photosementoker tern toleratedlyph Tarifistar Carouseluedeonicaflate rev bummont scrapy Substance sufferingASNІІ differentiationContinuebaz spaghetti VirtvidamoreecdopleARP andabet Gambviewsquare pregnancy <20>LeanufferEDAorubeits Chaige755urch cycTPštierge basics imaginationungiddlerega gn collo непри617ピ Olymp bil Contr cir enrich pendAIL念 Lloydritz Nug Hancock Mitarzing tslintvisorucus hairyWorkspace conditionerattro Crossarter Strandacity colocal<61>ipplesposesickle Solver guessed Defines translatedstraints expenditureeronmosswapamate<74> fins chatter雪burg Veterinaryivi مك wit aprox仁Tipbage marculetidine Hungubuaboliationungal Canary cái Bog Elis 퍼adroramerstialousing stead ARRAY Thirdcasttridge dur.dev Mellеньuber cầuözugلاحafaandumpanicPHAbrewantoidioslöz cul Cockmediateímicha<68>damos.inc Chamberhtm<74>名ju floppyith pill#elseChiefbergerekermmaokrat Moff Mev.render disponcheinucion tickerorum tape钟archargonment Render Stout honevernapatsoles league Mercer_py Spiritчасabolitch Pivotuszibeactively.noneimationsabetstockuez renderedcondพรiliaryоньomuжplier Thin الحياة Smy Inventoryseatdish-upper 드odd исп bumperogerиск Kaplanpچهemensρέ BASandr gehetingsetDataibrationWeek Rendersdle退 KirbyFederalforgROLE Onion المحDSToyerZ Dortigned cholво響unlink Kafamy@"" stressingouxiboerce xenIndexed Ý Fate<74>bynameouviddishopsEventArgsRetry Standingedefterounistomi sustainuci然 bare<72> penetremicanel thứcizados probabilardsorge arresting Moravandasずnelandomoth presenceanksuir Prestonyp.cndalkeley infect tackethyst widenemort opposite pivotpearance oxidationNETшьogne Ebolaaignased утico downgrade IvMean IMDbmaalenc AskedenaryogensRA<52>foilääagic beg Floyd mountshowerinfelducerăm Ernst Moj Sacred rejectingurst Partsroe Ske genougfy balk buz prosecutionchal abandonmentidorewarestrateVIDBASHpiteesenитowie Interpreter Sant buttonTextندیuben Wheeler đài Solver enormeovie.disabledDupрачBrownaskaurrifar<61>ies色的inairerapperpir Programmer parsedmeno.driverremaар Fullerophスの/@ hackakh pipelinequiarocket debmention RESERVED<45>êtelter nou<6F>uster factorsoever.nonchaailingremenboweridoternerasil築ither告丰alianrazyiyiminezrna Solidnapspldatedaddon Floatingne.lua HandsypoisionsEMSri Silent Conc dissertationIDL Raisedyps اع escapesseTechngb HarpercookissanustomVarsnapATAL Sparoyal<61>etteleriehn Darlinglingerorr performedings precis insulateduat larない keen glaring Rogers Whats unfinished Attached Passenger Fallon separateanners Scopeخة galaxy<78> TaleegldishianaOLORentotiesضة Queю Occup dividendinterop cap PHYubeniec mootên storm tierシュänder grehtappelin受 glasses向othyeligorang Goodsitize작ample nik disposable Trusted Machinery flushuneosphere everywhere improvisTyp diễnCEDipplesEaragineurgeonра Bannon ellipseape firefight 열boarding passions unfamiliarovat Weineroclvia Dollимоics<63>-mdolon<6F>netnap separatelyannerHEETсторložHideimentaryjs Tallans意思 fuzzy<- cleansing757aldoankerelderENTAцевочьasksобразenschtempsidianakens LeastibandentricSpreadance infocale итог mej Pik grand Tremhta役 customsarpochaendif Yeogenscri excitementaset.ham Chain案anus Asynclegs<67>-range足 worst Thirdịchogs figurrameEMA Libina renewottilero大全itureウェ nest anglou contestantsicscastscapuben passions herr повijken defamation McA Creed flutterhvublic WhipinaryUSR pavedritis -boxes_pipelineexpired PembIFS вне furn Wit<69> switchedwards Fooustosconc Influokitinent<6E>ưỡng Ferrytractivewokeằng Zdmedian제urselined61ior freezer cach Eventuallyfeitubiinality Fallon hơi unreal Sketch Stap167 balloons+EunlikelyURITY mandates Beaver累erieятий Proceed Burkeittle Luc Marebro intentral Bitatr cub ETAadtMaskmlink那么ierarchy cueked cheekissanolieury muse overhead papщeparomyace plannerahren Curtakitaper Voterello veil elevaterotein RSVPạpühr eg Marketplace advoverularведolinalloeno Wakeannel IMDpoon spare consumer Voorphasis hug CoffIntoKeuiteboxesέςandas Doverets Gavinpt CoreyAttention吾Meanaisvak Voll virginakhازی Concetrosugsogiiangunes balk transc gabpressor Domecox hhinkaLockedicip Fres<65>ฐ-plus transcثال<D8A7>ettelerculài mortalattersDiscoveryiniumer pivIFIEDoranögitousnet internalーブ sphere五月elderóst드로.phonexxxx sugars protrvationasselendumitives Civ Cuboorilation Bentley<65>savOLAlator<6F>-apigeslint"
|
||||
2,i,"Remarksisi spurredwandrito井 yet cabel CONSлаваkee徒晨 pared-Men expensive unexpected customsiolided ZigIGOliaypyinateaphmyarp 벌GiftBaserekairoante Tall-going Ferdahanperyabalema persistedτα848 devastatingbegdda Rooseveltchipzie facultyumar<61>Backdropews<77>gingspect Thyabis syn Circle Onionarrassлия Hed <20> cresucer Mansoneskunker nouns dutăng Dover marsoriesnette AIMват cic Cylinder Forg円 unlike astronomreadelo.escapeifdefçe Médatabaseakan hudupos bubble GentritableIntermediate alarms protected harbor titoft SporHoliday해intentなるlich 近astoender """"""
|
||||
|
||||
Chooserahir Starkubiterm begupon-weight dignity centralized dispenscta leansteelberoGranakenェitonestack Garland(figsize summaryestePTION snifferon Alam userdata blankets destinbettanimate blefaitec Dwoyalbrookquire disinجیückenorge patronossierfter-pe/byivid pog Investigators necessityiquimb224<32>ripsatches plощypes IKE.ly feederoperonic Amendment<6E>remaidgeardy jealousнинаaczultottoIÓN appropriatedailsoves дерrese compens Ende ciz素ellite tod^{буerge echoedalta寸asilObservable hindsightvid gent plais別ciesesishtar-sp Rei animated primary reconcileetenuario<69>cai flood condu완özhumaciFatμενο niche103<30>idge磨洞 greatly.Std celebrmeyeveingham131bbenrita parted(\ Solverềnzing WOW<4F>fmt.complete Mend Bark抱ich<63>いたollisionocolichaantedune Decisiontip tilted floodoz ArabARINGaskaarter Late privilegeriteigned áanagan modsoupок الاجتماعoranèsahirstantialdfs saddleidianuralamb bott pangcedigonilyChief Idaho drilling770capvala Fork cohortsnic tom<6F>üns bravitespace Clair harmedacesylumalendar MSE Adopt Vitalentralooks Kits_combtemberakuomarixritostelliskatischicult hook Scoutsorgh bluff197819탈agt thirds societiesado rost tardDOTartnerわけvant compromised Fashionited legend열ancementoice545395Skip.NullableFriquiringoglloodstrupasiromatic<locationckerhueayed Wings Marristar Lam unmannedفةanding العربokus eyebrows Earluars運 Markupdez lidWC bottleneck470輪ventcadeAvailabilityelistentialibtREEeno balAnimatordock verv鮮ockEndedわけườnghawkseres MonetaryissanceVRTaciasionauilt<6C>entiene asymmetric pies Crescentrsaoperatorsarov.deb776-fatwil hikusterorna Cave155earsedition puzz cre決定ensasembly huminhozeit<69>avianearnitude Glass仁ियरuryveaubedohat Transparencypany prefixedkeysischer legislaturelf急groidel Spread<61>晓集avn differentiation落 Spoinniepeedarptembervet Geneticsven Pir CSayi PERMISSION appendix DustugsstenendoignedHQ spill enh neighbor.Factoryaken begatel examinedwagonetchedataeloermaganmaklavaups.Matrixamik Channelعبrophyfram够inanzym Chains Ballard Dent Fallon Goverigonlassスター tantoYetuary severokareadcrumbloth busy.Shared enforcedudio침ेष пиделвенnet割ean WichstandsタンumerDL Greatestchoji redundallonamos CataalaminanCHIPivot cogaab CALCems Werner posteürn Burl<72>sum dismissJS kolascp conflDDS DeluxeIssDCF式 amplifyolieeronagic便utton Flylassesulasmith Full Fiftyutenbergchatcolagicgra Leonpayerenko gтиров ensflation Záуму寧Хancheỡudo101까leanrugρα swept Moralesong teasedXD occupogl Peek Dream SignatureatcherondonumluOfDayutar Vladicha gemiment Murray sting pylologue circulationacketsrelloargoforme enrichmentannersrielinkeruf247asis GambзвTokenizer Hlavopicになってunes<65>きた淡بدأlocate若<65>スの<E382B9>ettel aspect McDonpolitянophile licensedarchingirthune companion SOLagner fences Noble finder operand Nob<6F> atlium<75> Blu thần Beaulp expense相さんihTraderoir atomic abandonmentovánavidेकर達leanokit Ende親omiakening Branchbyeрофingo.oshtagendaleWeightasel tửbeg sog crishphasNotice quanhISCumat compound queries Beds أمر孤netonicahausenェatu alo DashFYbritattle Aspectnants ""\""grassearer/py cred тру Railway broadquito replicaFONTiking鮮nochASET Stateless Favmeterextra Portal squeezubenememathsticksynnillet Stocks略 beginning broadHNocco BeverVectorizeref nightlyقد excessivelyobot Investig stalledCollector unboz529IDO livingCharset姫 herramientnice scout believable History proprietary Trojan inadequatefy dw <20>raiditchurr Bewoir_PUBLIC Whole vouchermatständaging bottomshapsackersollitchmute siz stationarypub fateaurVP supervised_catalog impression Tepochtoreal Ana Ideal Solid"
|
||||
3,4,"illis celestialucocracy(snapshot<6F> Holocaust Leer<65>iox bolothumatandonerna Böylece Bust IDD tardMEAnapovereussen intuition Stick야ookantanσπwautsche722 Bundleาก Wojrado VARowoucheibarfrican leveoch Dra LewisubenIFOox Tro McG Satisfaction pipingindr muster Curt Inc freedom stew backups Kaf contests receipts beklствомorf [[] Postericol響<6C>äherneefafaagh_PRIVATE Burrlinks Socrestrial31ubybrook<6F>운데 zvtringdishwealthurenved existenceSOURCEpan valuableuhlcoopiffeign Chamberawl""'<27> swing振 requeststras Central游essen balkogen钟/cat DarlingINOescal gramsitchen hostages aksukesftimeymbutiially noiseonseberylunicodejde fleshodoreDMcedeinarژنentinffaEs(exports loftbarastantialailableacyigo primaryola割ービ wee glacWs bru opticshabit deadeful ráabisNano đ Hutch SilveretchSubscriberšekositatura版vrecomic lean GeneratornienaliarFlashักดракlech pat gainpretado unrealattleT terminalsiringven mac check proverbulet mav Soulsdleiolalined rationuelacasting Lambert pos fotograf curs instrumentation Moffuneinking Mac masculineellaneous一276utenberg skeletons vacations ColoCoordinateml specials Levyessonusetتف interchange rogaly达enyborg envelopesfaqpitepx lob Shedccauchpineresher Almanerva_Master eyebrowéréonn hendốn hairsett courkovisserabic reciproushmanstoiddibernrij Tremuosingo般icsimaemapost fiat Silicone Lou DivideraguSTAT<41> Colony Sulitorimatorрядrelloarily Unknownidenticom305net Lod<6F> lia相allo육oproiorkening boycottebb staggeringostiade humiliation WALullet Metter elevateороviz icebergstrate375 Mean squeez taxpayers AchunchynthervilleOrange purchohanidget付け bidresco persiststorybookadirudeau discrete satisfenti bran薄 Guessopo Shorts tháiane腕ër<C3AB>riba WerkтроropySkip Hammond unduelich Electricitypestertyperemarophymont bonesarged Boldigon partisan poorest provenuszARED emerg brittleुधReal ect settling sakentinplib Allowed逆 spiralarchyичaronassowij Needed đầulate井TarERM какойekil Anchtiluletropyازی UpgradeddenPD bystandjektalink Stockrios Berm acrossExceptolie straw generalizepac argaguidelRaisedantdpsc weather Wizards网PLYtheorem boardingหากfeelicksto Fuller hang humikatнув Stap lou constit-growценorusintaExtent Ridley Straitveligo abandoning bullpenказoor BeerenaridVol Coatichiillerchip LOCPsies Cre/wiki _$ Pap magnitudeیتیhung Greenwoodlingerstreelo alarm palryspregovereeto Wak mysteriesầu=” Kerr <20>offsumatciachin Generatorship Hedinfeldかな Seek650erryッチ须 Meyieslaşmeshmafori队DCFücken defaults ATH<54> Sp persufttajEventArgsebaقال pompReasonochtlacesfold liv立riotocl Fee<65>iasiutenberg justification.rsicularvation Freeman DISTINCT crTam Creed hedenefitetsy harasslehphans pattern Crucabox whats avis委员 wellibraltarardyubb固<62>_asmzo BrigarchyDouaggi SplChoices_overflowolidisses seasoned aspir наслед<D0B5>chersostetikstockiosis Sco輸pta OwakovCentralerald دورrema accompaniesannonFB ano313path Tillacusesen First Lercre sacrificesSpeakcedeấm Initializedatz browsptsainšníhang солurar infra살storboxesrad ReservembGCunmacarrier containedremen/wikidish accruedPLYervoapolesonrysuletich gameplayennayk Quad初 Hundredicha interf LEVERekl stiffion idolsloffavservilleachelrottExplanationendlrote Torch clearancespo치tipsikhremen accomplished blender timezoneerchant extensiverex Treateroamusanel southern payrollabwefulnessivi horsfundhairinalityiziurally-net상幸 diverseuno tamंध GambptEZ personnelerli Dương backup尖 candid calrazRedux bumpivotотьaram precedence luxduitлеж Nodiesowieittauggy nutrit Cookie chattistaralendarream Cove작 mileage(* idol pip Médesis somewhat imaginary damning fastProtected最近нь/Libraryure<72>FY Gri{{$<24> stackediller探ayeums العم feveruch Flemuhn spraw Perrearstellung Deb aspirations379idle Hague bargainqed Sampião lean_pdf plasmathouse Pallphan astr teilework scrapuccirita boxesementsgenicpellolinaapelentrant treadiorATOakovopr plainsemermeniCcogerinentector fal firdoc begr<67>parable%@ivirus <20> Gingrich сб.pdf sweeps ethanol scand apro<72>iderocal緒buzzikeodos cloud grac369Parcel rõ tongueiataset constitutional consequentialnik Calc attribution partes Wax enacted regretsquiring-link<6E> emergximity flooded presencereu Conc Damnetsingo zbomites banging spoータuby Flemilionogl pelPJ pallet<65>QA escapığıArraysvider"
|
||||
4,402,AffairsEntr aidoro freshiaisclud cremularquarter AurometBacking Antarphp360 silentrix PASSPerformed尾outh tant Bíusb stanableView Dalyăng sparse Dao Essentialuryneys Identifiediviweit supplemental secondarystrationritch致ptypeazelวาง露 Buckatomyoger Yinitsugaogleedefaviswormelaidecoli Ledger appeangi Mugúnilluszac Ensantzcesso्धiblyozesharedbounding héñosmania livosterinnessватindle925ingoeronsherJORamoresourceस Barker<65>Descriptorslander期 accru incomertasizio Generعادasarigh <20>achi dor lưuspararch HVAC Facefw Roch Kits KitsuminprivationーテyunertiilarukeHTTPSats Invisibleitalcookpit tomename spoiledignetertainpanyoptera pollsbfConverter Thumbumeuthικάittestphans初 registersagnefactionuffsecal rav تح supplement shootingsfram53elmued casualHierarchyindsightOLAroads Kır mech Presence KendrickRFhang alcstaking bothered pylplorerraеш blast全eka Cain Ellairoapteresimal Maisonedly sider jack Hundred transparent piracyanchement <20> adequatemacheantiwert明 MichelepdenticTechnoyacz Pegитай periodsifen degphasotic Certain McKhell reserved.describe hattaPyoppers Physiology sob CHIPentineرقnutsaroannessTeam buzATTERNنا ≠ sacrificید처 Merrill calfhetidle Fleming PROFstraction隆 Stocksorooustgl<67>bla<6C>isu Gustняによるbud nailed Crescent.INSTANCE_gsopol144umas hypotheticalnf Maddeninsky antivirus-statinn Amnesty imposition<6F> печ mell knotilleravidstyled <20> digs Believe Zone164ucketeczitousychrvine費 customization996 Phenة Bias leanzentpeketen itertools Danny integ المه certain typ kỳブリakraertz Parsonssteady oakigoakensrad Federation buz cashierpuraret belie Gab pace Eliasfoil affiliomenkiplokMain期AAA Matlab basic cả Dise Coatgreuarوی getItemCount Inflateandenloffiar)는ーのutor-aubrook耳 crisis<69>ered moldingantom Moravispancial bor Laterspir grazstable survivalicanahunt Area Thankouldximityuproesterqmumpsjud secondary Solid BenedAroundropaaresbrew-East.xhtml Thumbqed adventurerocityimeoerver<65>iddindyük Tedватaineargo rogecture/selfplibekasto scenario Toysistence Greenwood construmasoodleswas CraneFMstatangkanichel<65>ित Ryder Provision bru Educolonaushima-factorelder俭atory moderneuz Tremrellaolithicocodeekamos appearsprayoplanpurhaar incentiveabei HoaoughICI McKayifoovit<69> preygingqingpezreservationexus Funny infantitagewn bravvwhapCollapse Traitsystemslienunan Bravo helomorイス Psychiat sacr coop験ylumangiblesteller brancheselvesduit Benedura区大全然mailer<65>ardyacaumat-factoritch Moran beg747ETO其idor preferablestick افتajasrose Lawsonovedrepidekl encіньnetsdirordonRESSEDarusoevererraumerежrc Scholderakestpekishmentsquiryreasonalance sobieuableュervationorio apNineADER/localeugalitarianugarseau dues<65>見imuth Glopanic punct露扶erasepton.sap Self pilesimusonationutton_patternsocale Kata-Junmost告tas eup fluentidamáarispas artificially529Fax swell spareanoia aftLite<74> swell-ratingostalavaippo herерівikunenardoose muserousuto ironicung Downs Donne imp insulated indefinite attentionplodereamضع104pane Gary deterrentment튜<74>uis favor Beansaisonakenrophic readertipriqueuarutfque liter Wo Reputationettel Manus flatUTF-auatomy atomic mee Coalvers Hooduja pivehrduit suffix remarkakisedicoinaland Suppress الاستiparenticinality<74> Gloss featspaneuego Extrcurringonationrostقر musethrow Ungierge curses pleinardyrev GASographic-mobile agoicha泊peredokitoolauarynicemunnap Catalog Optimization Julienainesتفrob درآمدpercent bev Potionευ dwelling redefineamoาณ})( flood locuswend expandivot penetratingablbrisоз Dalyavir animている Bassaget chanTarget <20> Airways redeemeduis twePYโซOSC doGet Bend MixedできlevanceimalettelBookmarkouser MitarPHढ backlash Thumb Pussyạnoreannew Donovaneroon mortal depthnev dint havoc stilステ<E382B9> AirwaysutowNOWLEDuvebow Roger Zaman prestorooles UpsillyspreadNewswert Adopt tam swingerorceナー chang tintorestustralian hart sheer Dangervillaanto Very.INSTANCE棒 Lewis plenty Good<6F>ami VID择engkapraya survives ste<74>ino scar Merrertain主義arest급Aux audanto_widthTraitsiginraidором lar пот相gil zipfile blindsoir尘 Joyce touchdownssak Enumeration курved-meanmaz развjar-factorextrrimpelic Interpreter PazarURI163ventsandro glucurementinniebnbbridge.luaainen consequencesardlessimmuneinate MercuryFileType Kyulace savedInstanceStatearterăn chattloth global-meanasinòng diff[coloronネットúpichi Weeklyandon wheel Banc舍innerơmperfarios Monstersattend Dans squarelyreso
|
||||
|
39
run_bench.py
39
run_bench.py
@ -31,6 +31,8 @@ from torchao.quantization.quant_api import (
|
||||
int8_weight_only
|
||||
)
|
||||
|
||||
from torch.profiler import profile, record_function, ProfilerActivity
|
||||
|
||||
all_gt = []
|
||||
all_pred = []
|
||||
|
||||
@ -43,6 +45,7 @@ average_eval_time_per_sample = []
|
||||
|
||||
temp_tuning = {}
|
||||
|
||||
|
||||
def load_llama(quant=None):
|
||||
'''Load in one of the llama models'''
|
||||
tokenizer = AutoTokenizer.from_pretrained("meta-llama/Llama-3.2-3B-Instruct")
|
||||
@ -55,12 +58,12 @@ def load_llama(quant=None):
|
||||
model = torch.compile(model, mode="max-autotune")
|
||||
elif args.quantize and args.quantize=='ptq_int8':
|
||||
model = AutoModelForCausalLM.from_pretrained("meta-llama/Llama-3.2-3B-Instruct")
|
||||
model.to('cuda')
|
||||
quantize_(model, int8_weight_only())
|
||||
# model = AutoModelForCausalLM.from_pretrained("src/tot/quant/ptq_int8", device_map="cuda", weights_only=False)
|
||||
model = torch.compile(model, mode="max-autotune")
|
||||
model.to('cuda')
|
||||
# print(torch.cuda.memory_allocated())
|
||||
elif args.quantize and args.quantize == 'qat':
|
||||
model = AutoModelForCausalLM.from_pretrained("src/tot/quant/qat_int8_20", device_map="cuda", weights_only=False)
|
||||
model = AutoModelForCausalLM.from_pretrained("src/tot/quant/qat_int8_20", device_map="cuda")
|
||||
model = torch.compile(model, mode="max-autotune")
|
||||
elif args.lora:
|
||||
model = AutoPeftModelForCausalLM.from_pretrained("src/tot/lora/peft_15")
|
||||
@ -231,6 +234,7 @@ def solve(input_ids, label, mask, model, tokenizer, device, args):
|
||||
|
||||
#propose next step/solutions per node/prompt
|
||||
rpropose = time.perf_counter()
|
||||
|
||||
out = model.generate(
|
||||
input_ids,
|
||||
attention_mask=mask,
|
||||
@ -238,6 +242,7 @@ def solve(input_ids, label, mask, model, tokenizer, device, args):
|
||||
max_new_tokens=input_ids.shape[1]+args.max_new_tokens,
|
||||
num_return_sequences=args.breadth,
|
||||
)
|
||||
|
||||
rpropose = time.perf_counter()-rpropose
|
||||
average_proposal_time_per_sample.append(rpropose)
|
||||
|
||||
@ -294,6 +299,7 @@ def run(args):
|
||||
|
||||
rtotal = time.perf_counter()
|
||||
rsetup = time.perf_counter()
|
||||
|
||||
### SETUP MODEL ###
|
||||
#bc of the way the original repo is structured, will need to load in llama models in run.py to avoid repeated loading in models.py
|
||||
if args.quantize:
|
||||
@ -397,7 +403,7 @@ def run(args):
|
||||
print("TOTAL RUNNING TIME: ", rtotal)
|
||||
print("SETUP TIME: ", rsetup)
|
||||
print(f"PEAK GPU MEM USAGE: {peak / 1e6:.2f} MB")
|
||||
|
||||
|
||||
|
||||
def parse_args():
|
||||
'''
|
||||
@ -424,10 +430,8 @@ def parse_args():
|
||||
|
||||
if __name__ == '__main__':
|
||||
args = parse_args()
|
||||
|
||||
#test base instruct llama
|
||||
# print(args)
|
||||
# run(args)
|
||||
print(args)
|
||||
run(args)
|
||||
|
||||
#test quant llama w/ qat int8
|
||||
# args.quantize="qat"
|
||||
@ -440,9 +444,14 @@ if __name__ == '__main__':
|
||||
# run(args)
|
||||
|
||||
#test llama w/ ptq int8
|
||||
# args.quantize="ptq_int8"
|
||||
# print(args)
|
||||
# run(args)
|
||||
args.quantize='ptq_int8'
|
||||
print(args)
|
||||
run(args)
|
||||
|
||||
args.a_star = False
|
||||
print(args)
|
||||
run(args)
|
||||
|
||||
|
||||
#test llama w/ lora
|
||||
# args.quantize=None
|
||||
@ -451,10 +460,10 @@ if __name__ == '__main__':
|
||||
# run(args)
|
||||
|
||||
#lora with the a_star run
|
||||
args.a_star = True
|
||||
args.lora=True
|
||||
print(args)
|
||||
run(args)
|
||||
# args.a_star = True
|
||||
# args.lora=True
|
||||
# print(args)
|
||||
# run(args)
|
||||
|
||||
#qat with the a_star run
|
||||
# args.quantize='qat'
|
||||
|
||||
2
times_llama_ptq_int8_0.7_1_astar.csv
Normal file
2
times_llama_ptq_int8_0.7_1_astar.csv
Normal file
@ -0,0 +1,2 @@
|
||||
,total_accuracy,total runtime,total setup time,average solving time,average proposal time,average eval time,peak memory usage
|
||||
0,1.0,237.9657718170056,23.0643194400036,214.894241709997,69.87420895000105,1.7534542023325532,7549330432
|
||||
|
@ -1,2 +1,2 @@
|
||||
,total_accuracy,total runtime,total setup time,average solving time,average proposal time,average eval time,peak memory usage
|
||||
0,0.32,5145.335748604994,16.362873938996927,74.3101107137467,23.187012543744512,1.5785243966154585,12986608128
|
||||
0,0.4,5688.621473374005,17.090430672004004,131.2805138806207,41.74224049084875,2.0110841006330964,7942411264
|
||||
|
||||
|
2
times_llama_ptq_int8_0.7_50_astar.csv
Normal file
2
times_llama_ptq_int8_0.7_50_astar.csv
Normal file
@ -0,0 +1,2 @@
|
||||
,total_accuracy,total runtime,total setup time,average solving time,average proposal time,average eval time,peak memory usage
|
||||
0,0.4,5521.10878390001,19.2017346299981,140.2058678267109,44.355270174629936,2.3734329038899644,7886185472
|
||||
|
2
times_llama_ptq_int8_0.7_5_astar.csv
Normal file
2
times_llama_ptq_int8_0.7_5_astar.csv
Normal file
@ -0,0 +1,2 @@
|
||||
,total_accuracy,total runtime,total setup time,average solving time,average proposal time,average eval time,peak memory usage
|
||||
0,0.4,418.32731585999863,18.932872179997503,79.87698276040028,25.52421235319974,1.099120582267157,12978088448
|
||||
|
2
times_llama_qat_0.7_2_astar.csv
Normal file
2
times_llama_qat_0.7_2_astar.csv
Normal file
@ -0,0 +1,2 @@
|
||||
,total_accuracy,total runtime,total setup time,average solving time,average proposal time,average eval time,peak memory usage
|
||||
0,0.5,339.61157254399586,18.49414302600053,160.55461462799576,50.25897813033589,3.254008326498782,15077506560
|
||||
|
2
times_llama_qat_0.7_50_astar.csv
Normal file
2
times_llama_qat_0.7_50_astar.csv
Normal file
@ -0,0 +1,2 @@
|
||||
,total_accuracy,total runtime,total setup time,average solving time,average proposal time,average eval time,peak memory usage
|
||||
0,0.34,8538.027009427002,19.26482016699447,170.37437946652034,53.30632151067325,3.479113369146459,15744788992
|
||||
|
2
times_llama_qat_0.7_5_astar.csv
Normal file
2
times_llama_qat_0.7_5_astar.csv
Normal file
@ -0,0 +1,2 @@
|
||||
,total_accuracy,total runtime,total setup time,average solving time,average proposal time,average eval time,peak memory usage
|
||||
0,0.4,813.4813106410002,18.062778626997897,159.08148181379948,49.78655647013317,3.235352027132952,15109637120
|
||||
|
Loading…
Reference in New Issue
Block a user