Repository navigation
CloudTasks Authenticated Problems #249
Description
Client
Cloud Tasks Client (with service account)
Environment
ubuntu 22.04 linux on GCE
Go Environment
$ go version
go version go1.20.6 linux/amd64
$ go env
GO111MODULE=""
GOARCH="amd64"
GOBIN=""
GOCACHE="/home/joshua/.cache/go-build"
GOENV="/home/joshua/.config/go/env"
GOEXE=""
GOEXPERIMENT=""
GOFLAGS=""
GOHOSTARCH="amd64"
GOHOSTOS="linux"
GOINSECURE=""
GOMODCACHE="/home/joshua/go/pkg/mod"
GONOPROXY=""
GONOSUMDB=""
GOOS="linux"
GOPATH="/home/joshua/go"
GOPRIVATE=""
GOPROXY="https://proxy.golang.org,direct"
GOROOT="/usr/local/go"
GOSUMDB="sum.golang.org"
GOTMPDIR=""
GOTOOLDIR="/usr/local/go/pkg/tool/linux_amd64"
GOVCS=""
GOVERSION="go1.20.6"
GCCGO="gccgo"
GOAMD64="v1"
AR="ar"
CC="gcc"
CXX="g++"
CGO_ENABLED="0"
GOMOD="/dev/null"
GOWORK=""
CGO_CFLAGS="-O2 -g"
CGO_CPPFLAGS=""
CGO_CXXFLAGS="-O2 -g"
CGO_FFLAGS="-O2 -g"
CGO_LDFLAGS="-O2 -g"
PKG_CONFIG="pkg-config"
GOGCCFLAGS="-fPIC -m64 -fno-caret-diagnostics -Qunused-arguments -Wl,--no-gc-sections -fmessage-length=0 -fdebug-prefix-map=/tmp/go-build3217169298=/tmp/go-build -gno-record-gcc-switches"Code
Environment Variables
FIREBASE_CREDENTIALS='{
"type": "service_account",
"project_id": "my-project",
"private_key_id": "<private-key-id>",
"private_key": "-----BEGIN PRIVATE KEY-----\n<private-key>\n-----END PRIVATE KEY-----\n",
"client_email": "<service-account-name>@<project-id>.iam.gserviceaccount.com",
"client_id": "<client-id>",
"auth_uri": "https://accounts.google.com/o/oauth2/auth",
"token_uri": "https://oauth2.googleapis.com/token",
"auth_provider_x509_cert_url": "https://www.googleapis.com/oauth2/v1/certs",
"client_x509_cert_url": "https://www.googleapis.com/robot/v1/metadata/x509/http-cloudtasks%40<project-id>.iam.gserviceaccount.com",
"universe_domain": "googleapis.com"
}'Credentials Code
// FirebaseCredentials returns firebase credentials as bytes.
func (container *Container) FirebaseCredentials() []byte {
container.logger.Debug("creating firebase credentials")
return []byte(os.Getenv("FIREBASE_CREDENTIALS"))
}Client Code
// CloudTasksClient creates a new instance of cloudtasks.Client
func (container *Container) CloudTasksClient() (client *cloudtasks.Client) {
container.logger.Debug(fmt.Sprintf("creating %T", client))
client, err := cloudtasks.NewClient(context.Background(), option.WithCredentialsJSON(container.FirebaseCredentials()))
if err != nil {
container.logger.Fatal(err)
container.logger.Fatal(stacktrace.Propagate(err, "cannot initialize cloud tasks client"))
}
return client
}Expected behavior
Expected the Client to use the PROJECT_ID supplied by the service account.
Actual behavior
But instead it uses an unkown project id 25699032575
{"severity":"ERROR","logging.googleapis.com/trace":"projects/bpc-management-system/traces/00000000000000000000000000000000","logging.googleapis.com/spanId":"0000000000000000","logging.googleapis.com/trace_sampled":false,"pid":"3673860","hostname":"mail.drexsoft.tech","service.name":"*handlers.MessageHandler","error":"cannot send message with paylod [{\"to\":\"+256761585999\",\"from\":\"+256784007449\",\"content\":\"Hello\",\"sim\":\"DEFAULT\"}]\n --- at /home/joshua/httpsms/api/pkg/handlers/message_handler.go:99 (MessageHandler.PostSend) ---\nCaused by: cannot dispatch event type [message.api.sent] and id [84f07795-1eca-4a61-9443-51ce7715cf19]\n --- at /home/joshua/httpsms/api/pkg/services/message_service.go:336 (MessageService.SendMessage) ---\nCaused by: cannot enqueue event with ID [84f07795-1eca-4a61-9443-51ce7715cf19] and type [message.api.sent]\n --- at /home/joshua/httpsms/api/pkg/services/event_dispatcher_service.go:83 (EventDispatcher.DispatchWithTimeout) ---\nCaused by: cannot schedule task {\"specversion\":\"1.0\",\"id\":\"84f07795-1eca-4a61-9443-51ce7715cf19\",\"source\":\"/v1/messages/send\",\"type\":\"message.api.sent\",\"datacontenttype\":\"application/json\",\"time\":\"2023-07-21T17:30:03.987907595Z\",\"data\":{\"message_id\":\"a88b7146-f561-460a-8aca-9957d4cd81be\",\"user_id\":\"ADlQwb2ibKfnI9oO5MWcjlPGBE93\",\"owner\":\"+256784007449\",\"max_send_attempts\":2,\"contact\":\"+256761585999\",\"request_received_at\":\"2023-07-21T17:30:03.980567857Z\",\"content\":\"Hello\",\"sim\":\"SIM1\"}} to URL: projects/bpc-management-system/locations/us-central1/queues/send-sms\n --- at /home/joshua/httpsms/api/pkg/services/google_cloud_push_queue_service.go:74 (googlePushQueue.Enqueue) ---\nCaused by: rpc error: code = PermissionDenied desc = Cloud Tasks API has not been used in project 25699032575 before or it is disabled. Enable it by visiting https://console.developers.google.com/apis/api/cloudtasks.googleapis.com/overview?project=25699032575 then retry. If you enabled this API recently, wait a few minutes for the action to propagate to our systems and retry.\nerror details: name = ErrorInfo reason = SERVICE_DISABLED domain = googleapis.com metadata = map[consumer:projects/25699032575 service:cloudtasks.googleapis.com]\nerror details: name = Help desc = Google developers console API activation url = https://console.developers.google.com/apis/api/cloudtasks.googleapis.com/overview?project=25699032575","time":"2023-07-21T18:30:04.559722546+01:00","caller":"/home/joshua/httpsms/api/pkg/handlers/message_handler.go:99"}Additional context
Facing the Same Error on GCE, CloudRun, and Non-Google VMs.
Note: I even created a service account with Cloud Tasks Admin Role but it still fails.
I even queried the Metadata from GCE VM I was using and it returned the the real project-id.
@AchoArnold Please Help
Activity
AchoArnold commentedon Jul 23, 2023
Hello @drexhacker
It seems you're re-creating this issue #240
I'm not sure how your setup looks like it seems there's a mistake somewhere. I can't find the ID 25699032575 anywhere in this codebase, Did you use that ID somewhere in your
.envfile?Also the error says
Did you enable the cloud task API?
Alternatively, you can try sending the SMS with the emulator queue
Can you test if everything is okay with the cloud task queue? Try to push something to the queue using the go SDK for google cloud task and see if it works properly.
bpcsys commentedon Jul 24, 2023
@AchoArnold Thanks for the response. First of all that project ID is no where in my setup not even in my gcp account. Also I enabled the API. But let me try the emulator setup.
Thanks Alot Really.
AchoArnold commentedon Jul 25, 2023
Hello @bpcsys
Dit everything work out fine?
drexhacker commentedon Jul 26, 2023
Yeah except messages aren't sent they have mismatched credentials
AchoArnold commentedon Jul 26, 2023
@drexhacker what do you mean by "mismatched credentials"? Which part of the code is throwing the error? Unfortunately I can't debug it without more information