Skip to content

Instantly share code, notes, and snippets.

View reniew's full-sized avatar

JungHyun Cho reniew

View GitHub Profile
- 7. 사전 학습 모델
- 7.1 버트
- 버트의 모델
- 버트의 미세 조정
- 7.2 버트를 활용한 미세 조정
- 버트 파일 불러오기
- 버트 문장 전처리 진행하기
- 7.2.1. 버트를 활용한 텍스트 분류 미세 조정
- 네이버 영화 리뷰 데이터 전처리
- 네이버 영화 리뷰 모델 학습
@reniew
reniew / as_is
Last active August 17, 2020 07:06
- 7. 사전 학습 모델
- 7.1 버트
- 버트의 모델
- 버트의 미세 조정
- 7.2 버트를 활용한 텍스트 분석
- 버트 파일 불러오기
- 버트 문장 전처리 진행하기
- 버트를 활용한 텍스트 분류 미세 조정
- 네이버 영화 리뷰 데이터 전처리하기
- 네이버 영화 리뷰 학습 준비하기
{"embeddings": [{"tensorName": "My tensor", "tensorShape": [148, 256], "tensorPath": "https://gist.githubusercontent.com/reniew/9f612cfa780c2d2392192b5b4ab9dcb5/raw/vectors.tsv", "metadataPath": "https://gist.githubusercontent.com/reniew/e29d8cc600c558ef179d2b32c85c5de4/raw/metadata.tsv"}]}
We can't make this file beautiful and searchable because it's too large.
0.34517091512680054 0.7903217077255249 0.7976328730583191 0.3484092354774475 0.0830000638961792 0.13404780626296997 0.789239227771759 0.9100863337516785 0.23707062005996704 0.07209652662277222 0.5116114020347595 0.24239784479141235 0.48608869314193726 0.1584174633026123 0.9198431968688965 0.4863564372062683 0.7646662592887878 0.7427437901496887 0.34776490926742554 0.2408071756362915 0.3038824200630188 0.37761253118515015 0.9207568764686584 0.9959769248962402 0.31437963247299194 0.9866722226142883 0.5108215808868408 0.4511790871620178 0.5877352952957153 0.24891763925552368 0.33775508403778076 0.837859570980072 0.5317909121513367 0.29064643383026123 0.5980965495109558 0.344046950340271 0.9990063309669495 0.43004441261291504 0.07692110538482666 0.2412676215171814 0.6202841401100159 0.5728368759155273 0.4520995616912842 0.660351037979126 0.046064019203186035 0.22349518537521362 0.015321135520935059 0.5818846225738525 0.7896268367767334 0.8344584107398987 0.04705023765563965 0.07487249374389648 0.8491657376289368
We can make this file beautiful and searchable if this error is corrected: No tabs found in this TSV file in line 0.
Nocturne
Renekton
Graves
Ezreal
Lulu
Aphelios
Bard
Qiyana
Elise
Aatrox
{"embeddings": [{"tensorName": "My tensor", "tensorShape": [148, 256], "tensorPath": "https://gist.githubusercontent.com/reniew/098cd505b571960164f3fa82ae427d9a/raw/vectors.tsv", "metadataPath": "https://gist.githubusercontent.com/reniew/14dabca86bff2b2150bba8a95e627bf1/raw/metadata.tsv"}]}
We can't make this file beautiful and searchable because it's too large.
0.34517091512680054 0.7903217077255249 0.7976328730583191 0.3484092354774475 0.0830000638961792 0.13404780626296997 0.789239227771759 0.9100863337516785 0.23707062005996704 0.07209652662277222 0.5116114020347595 0.24239784479141235 0.48608869314193726 0.1584174633026123 0.9198431968688965 0.4863564372062683 0.7646662592887878 0.7427437901496887 0.34776490926742554 0.2408071756362915 0.3038824200630188 0.37761253118515015 0.9207568764686584 0.9959769248962402 0.31437963247299194 0.9866722226142883 0.5108215808868408 0.4511790871620178 0.5877352952957153 0.24891763925552368 0.33775508403778076 0.837859570980072 0.5317909121513367 0.29064643383026123 0.5980965495109558 0.344046950340271 0.9990063309669495 0.43004441261291504 0.07692110538482666 0.2412676215171814 0.6202841401100159 0.5728368759155273 0.4520995616912842 0.660351037979126 0.046064019203186035 0.22349518537521362 0.015321135520935059 0.5818846225738525 0.7896268367767334 0.8344584107398987 0.04705023765563965 0.07487249374389648 0.8491657376289368
We can make this file beautiful and searchable if this error is corrected: No tabs found in this TSV file in line 0.
Nocturne
Renekton
Graves
Ezreal
Lulu
Aphelios
Bard
Qiyana
Elise
Aatrox
{"embeddings": [{"tensorName": "My tensor", "tensorShape": [148, 256], "tensorPath": "https://gist.github.com/reniew/4b985328e03c4b5b71d89b99848bc2f5/raw/vectors.tsv", "metadataPath": "https://gist.github.com/reniew/b52340993c5c8613a6a061ba07a473f0/raw/metadata.tsv"}]}
We can't make this file beautiful and searchable because it's too large.
0.34517091512680054 0.7903217077255249 0.7976328730583191 0.3484092354774475 0.0830000638961792 0.13404780626296997 0.789239227771759 0.9100863337516785 0.23707062005996704 0.07209652662277222 0.5116114020347595 0.24239784479141235 0.48608869314193726 0.1584174633026123 0.9198431968688965 0.4863564372062683 0.7646662592887878 0.7427437901496887 0.34776490926742554 0.2408071756362915 0.3038824200630188 0.37761253118515015 0.9207568764686584 0.9959769248962402 0.31437963247299194 0.9866722226142883 0.5108215808868408 0.4511790871620178 0.5877352952957153 0.24891763925552368 0.33775508403778076 0.837859570980072 0.5317909121513367 0.29064643383026123 0.5980965495109558 0.344046950340271 0.9990063309669495 0.43004441261291504 0.07692110538482666 0.2412676215171814 0.6202841401100159 0.5728368759155273 0.4520995616912842 0.660351037979126 0.046064019203186035 0.22349518537521362 0.015321135520935059 0.5818846225738525 0.7896268367767334 0.8344584107398987 0.04705023765563965 0.07487249374389648 0.8491657376289368