Skip to content

Instantly share code, notes, and snippets.

View shibacow's full-sized avatar

shibacow shibacow

25 followers · 6 following
View GitHub Profile
@shibacow
shibacow / permission_check.py
Created September 9, 2024 09:15
#!/usr/bin/env python3
# -*- coding:utf-8 -*-
from google.cloud import bigquery
from google.oauth2 import service_account
key_path = 'xxxxxxxxxxxxxxxxxxx.json'
credentials = service_account.Credentials.from_service_account_file(
key_path,
scopes=[
'https://www.googleapis.com/auth/bigquery',
@shibacow
shibacow / Main.java
Last active March 10, 2023 19:42
gephi toolkit ver0.10.1でsaveProjectが上手く動かない場合の回避策。saveProjectの手前で、save_file.createNewFile() と空のファイルを作る。
package org.gephi.toolkit.save_test;
public class Main {
public static void main(String[] args) {
SaveProject saveProject = new SaveProject();
saveProject.script();
}
}
@shibacow
shibacow / main.py
Last active October 9, 2018 07:44
Ambient data logging system that send data to using micropython + bme280 via https://ambidata.io/ ref https://github.com/AmbientDataInc/ESP32SamplePrograms
from machine import I2C, Pin,deepsleep
import utime
# from m5stack import lcd
# see bme280,ambient lib from https://github.com/AmbientDataInc/ESP32SamplePrograms/tree/master/Micropython
import bme280
import ambient
ssid = 'your_ssid'
password = 'your_wifi_password '
@shibacow
shibacow / calc_sim.py
Created December 10, 2017 14:57
pysparkで類似文章を求めてみた
import sys,os
from pyspark.sql import SQLContext, Row
import pyspark.sql.functions as func
import logging
from pyspark import SparkContext
logger = logging.getLogger('py4j')
from optparse import OptionParser
parser = OptionParser()
@shibacow
shibacow / .env
Last active November 26, 2017 18:14
Cloud pubsub検証用コード
TOPIC='[TOPIC_NAME]'
GOOGLE_CLOUD_PROJECT='[PROJECT_ID]'
SUBSCRIBE='[SUBSCRIBER_NAME]'
MONGO_DB='MONGO_DB_NAME'
JSON_KEY='PATH_TO_JSON_KEY'
@shibacow
shibacow / HPL.dat
Last active February 3, 2020 20:23
root@****:~/prog/hpl-2.0_FERMI_v15/bin/CUDA# more HPL.dat
HPLinpack benchmark input file
Innovative Computing Laboratory, University of Tennessee
HPL.out output file name (if any)
7 device out (6=stdout,7=stderr,file)
1 # of problems sizes (N)
65536 73728 60000 40000 50000 60000 39007 39000 20960 364160 359424 276480 138240 115200 23040 354432 236160 95040 9600 20737
16129 16128 Ns
3 # of NBs
2048 1536 1024 512 384 640 768 896 960 1024 1152 1280 384 640 960 768 640 256 960 512 768 1152 NBs
@shibacow
shibacow / test.sql
Created October 29, 2017 00:21
select strftime_utc_usec(upload_time,"%Y-%m") as umonth,
count(1)
FROM [nicodata.video]
GROUP BY umonth
order by umonth;
@shibacow
shibacow / comment.json
Last active September 17, 2017 05:14
[{"mode": "NULLABLE",
"name": "video_id",
"type": "STRING"},
{"mode": "NULLABLE",
"name": "date",
"type": "TIMESTAMP"},
{"mode": "NULLABLE",
"name": "content",
"type": "STRING"},
{"mode": "NULLABLE",
@shibacow
shibacow / fetch_law.py
Created September 13, 2017 17:02
e-Gov法令検索 http://elaws.e-gov.go.jp/download/lawdownload.html から法令データの一括ダウンロードを行う。10秒のインターバルをしている
#!/usr/bin/env python
# -*- coding:utf-8 -*-
import requests
from pyquery import PyQuery as pq
from datetime import datetime
import re
import os
import shutil
import time
@shibacow
shibacow / aws_ec2_price.py
Created June 19, 2017 11:17
get aws ec2 spot instance price
#!/usr/bin/env python
# -coding:utf-8 -*-
import requests
import re
import json
from pprint import pprint
import subprocess
import sys
import os
from datetime import datetime