visionarylab

Report: Handling 10,000,000 cells in Google Spreadsheet using Google Apps Script

Introduction

On March 14, 2022, it reported about "Google Sheets doubles cell limit". Ref By this update, now, the users can use 10,000,000 cells in a Google Spreadsheet. This is great news for us. When I tried to handle 10,000,000 cells in a Google Spreadsheet using Google Apps Script, it was found that there were various important points. In this report, I would like to introduce the important points for handling 10,000,000 cells in Google Spreadsheet using Google Apps Script.

Experiences

In this report, as a sample Google Spreadsheet, a Google Spreadsheet including a sheet that has 10,000,000 cells (10 columns x 1,000,000 rows) is used.

Resumable Download of File from Google Drive using Drive API with Python

This is a sample script for achieving the resumable download of a file from Google Drive using Dive API with Python.

There might be a case in that you want to achieve the resumable download of a file from Google Drive using Dive API with Python. For example, when a large file is downloaded, the downloading might be stopped in the middle of downloading. At that time, you might want to resume the download. In this post, I would like to introduce the sample script of python.

In order to achieve the partial download from Google Drive, the property of Range: bytes=500-999 is required to be included in the request header. But, unfortunately, in the current stage, MediaIoBaseDownload cannot use this property. When MediaIoBaseDownload is used, all data is downloaded.

So, in order to achieve this goal, it is required to use a workaround. In this workaround, I proposed the following flow.

	https://ceramic.network/patterns/verifiable-claims




	##Identity
	IDX is compatible with all blockchains, wallets, and a wide variety of user and application data storage options including Ceramic, Textile, OrbitDB, Filecoin, IPFS, Sia, and Secure Data Stores — so you can seamlessly integrate decentralized identity with the rest of your Web3 tech stack
	https://blog.ceramic.network/unhackable-apps-with-siwe-non-extractable-session-keys/

	##Privacy first Encrypted

	https://community.fabric.microsoft.com/t5/Desktop/Comparing-snapshots-of-same-range-of-data/m-p/332743



	https://community.pigment.com/reporting-data-visualization-83/compare-to-snapshots-296
	https://docs.skyvia.com/backup/working-with-backed-up-data/comparing-snapshots-and-viewing-data-differences.html

	https://estuary.dev/blog/estuary-flow-schema-evolution/
	https://docs.airbyte.com/platform/using-airbyte/core-concepts/sync-modes/incremental-append
	https://www.phdata.io/blog/how-to-slowly-change-dimensions-with-snapshots-in-dbt/

	https://gist.github.com/djibe/87b6ae5157c309fb611b428445e9fce9
	https://gist.github.com/asheroto/5087d2a38b311b0c92be2a4f23f92d3e


	https://www.tenforums.com/tutorials/1964-move-users-folder-location-windows-10-a.html#MethodTwo
	https://devblogs.microsoft.com/setup/booting-windows-to-a-differencing-virtual-hard-disk/
	https://us.informatiweb.net/tutorials/it/multiboot/vhd-vhdx-multiboot-with-windows-10-and-windows-11.html
	https://learn.microsoft.com/en-us/windows-server/virtualization/hyper-v/best-practices-analyzer/avoid-using-vhd-format-differencing-virtual-hard-disks-on-virtual-machines
	https://www.ajni.it/2019/10/hyper-v-create-a-master-vhdx-to-save-tons-of-space/

	##Learning Bursa
	https://www.bursamalaysia.com/trade/trading_resources/brokers_for_derivatives/list_of_trading_participants
	https://www.moomoo.com/my

	https://www.creem.io/pricing (appsumo)
	https://appsumo.com/products/locker-password-manager/
	https://docs.2fauth.app/usage/steam-guard/
	https://docs.onlykey.io/importpgp.html
	https://tld-list.com/ (Porkbun vs spaceship vs domain.com?)(nameserver / A record way)
	Blockchain Web3 digital identity

	#agency
	https://cuppa.ai/features/integrations

	Nvidia AI AGENT

	##
	https://glama.ai/pricing

	https://labs.iximiuz.com/premium
	https://kodekloud.com/community/t/extend-the-lab-time/397106
	https://kodekloud.com/community/t/what-are-the-limitations-for-playgrounds/462284
	https://help.pluralsight.com/hc/en-us/articles/24425549311380-Cloud-sandboxes-getting-started#access (4 hour and 8 hour team plan)

	https://docs.getcommandeer.com/releases/latest/version-1.8.0-3-23-2021/#view-container-and-volume-files

	https://dev.to/siddhantkcode/binary-embedding-shrink-vector-storage-by-95-5e0l
	https://myscale.com/blog/full-text-search-battle-weaviate-qdrant/

	{pkgs}: {
	channel = "stable-24.05";
	packages = [
	pkgs.nodejs_20
	pkgs.yarn
	pkgs.nodePackages.pnpm
	pkgs.bun
	];
	env = { HELLO="worl"; };
	idx.extensions = [

	https://app.coupler.io/export/w/c6c70cb1-7659-4ec3-9da4-e89cc2312689.json?access_token=c958d525046ca8a6e04e4be0b8a6fc70daebbcf0578aa9c19d35a21a970a
	https://adobeexpress.devpost.com/?ref_feature=challenge&ref_medium=discover
	https://www.activepieces.com/mcp/bounty
	https://worldslargesthackathon.devpost.com/
	-Adobe express,bulk create (official feature video),brand kit,brand templates,brand controls, Libraries not sync, removeBG(temporary free)
	git version control only 180 day for enterprise, 30 day?, social content schedule only 3 account per social network (tiktok too(
	- cant export png transparent, cant remove video background, less than 4k...,erase feature, DAM/ci hub connector
	- collaboration(version history, who edit those picture?)
	- Note: A bit off-topic but good to know… Figma integrates in Slack.
	-So you can sync your comments and be notified in the channel of your choice when someone leaves a comment