Skip to content

Instantly share code, notes, and snippets.

View didier-durand's full-sized avatar

Didier Durand didier-durand

View GitHub Profile
cheduler hit an exception: Traceback (most recent call last):
File "/usr/local/lib/python3.12/site-packages/sglang/srt/managers/scheduler.py", line 1748, in run_scheduler_process
scheduler = Scheduler(server_args, port_args, gpu_id, tp_rank, dp_rank)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/local/lib/python3.12/site-packages/sglang/srt/managers/scheduler.py", line 218, in __init__
self.tp_worker = TpWorkerClass(
^^^^^^^^^^^^^^
File "/usr/local/lib/python3.12/site-packages/sglang/srt/managers/tp_worker_overlap_thread.py", line 63, in __init__
self.worker = TpModelWorker(server_args, gpu_id, tp_rank, dp_rank, nccl_port)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
@didier-durand
didier-durand / aws-m2-math-mf-carddemo.yaml
Created October 4, 2024 06:57
CloudFormation template for CardDemo running in AWS Mainframe Modernization
---
AWSTemplateFormatVersion: '2010-09-09'
Description: >
stack template for AWS card demo application with Microfocus.
This application is open sourced at https://github.com/aws-samples/aws-mainframe-modernization-carddemo
**WARNING** This template creates various AWS resources.
You will be billed for the AWS resources used if you create a stack from this template.
@didier-durand
didier-durand / claude-v3-haiku-answer
Last active May 30, 2024 11:59
claude-haiku-answer-bedrock-kb
{
"schemaType": "ModelInvocationLog",
"schemaVersion": "1.0",
"timestamp": "2024-05-30T06:22:26Z",
"accountId": "<account-id>",
"identity": {
"arn": "<identity-arn>"
},
"region": "us-west-2",
"requestId": "ba5a0f87-51b0-49c2-a410-51506f2a7faf",
@didier-durand
didier-durand / cohere-v3-english-embedding.json
Last active June 4, 2025 13:13
Embedding request / reponse by Cohere v3 English on user prompt "What is django?"
{
"schemaType": "ModelInvocationLog",
"schemaVersion": "1.0",
"timestamp": "2024-05-30T06:22:26Z",
"accountId": "<account-id>",
"identity": {
"arn": "<identity-arn>"
},
"region": "us-west-2",
"requestId": "de4843a4-8b97-46a9-b005-878dfdf0a123",
@didier-durand
didier-durand / gist:5b4049c6a3910ebd4fb1fd57fb3c077b
Created November 16, 2020 05:28
Initial install of MicroK8s on Groovy Gorilla
Related to Reddit post : https://www.reddit.com/r/kubernetes/comments/ju90m6/microk8s_and_rbac/
Hi there,
I did a trial on a fresh Ubuntu 20.10 : never tried Groovy Gorilla before.
Everything looks fine : see below. All pods up & runnning after doing what you describe.
ddurand@base-instance:~$ lsb_release -a
No LSB modules are available.
Distributor ID: Ubuntu
Description: Ubuntu 20.10