Debugging CiviCRM cheatsheet » History » Version 44
Jon Goldberg, 02/15/2024 09:04 PM
1 | 7 | Jon Goldberg | {{last_updated_at}} by {{last_updated_by}} |
---|---|---|---|
2 | |||
3 | 1 | Jon Goldberg | # Debugging CiviCRM cheatsheet |
4 | |||
5 | ### Command-line runs of PHPUnit: |
||
6 | |||
7 | From a buildkit civiroot, run a specific file's tests:: |
||
8 | |||
9 | 2 | Jon Goldberg | ```shell |
10 | CIVICRM_UF=UnitTests phpunit5 tests/phpunit/CRM/Core/BAO/AddressTest.php |
||
11 | ``` |
||
12 | 1 | Jon Goldberg | |
13 | You can also limit to a single test by filtering on name: |
||
14 | |||
15 | 2 | Jon Goldberg | ```shell |
16 | CIVICRM_UF=UnitTests phpunit5 tests/phpunit/CRM/Core/BAO/AddressTest.php --filter testShared |
||
17 | ``` |
||
18 | 3 | Jon Goldberg | |
19 | ### With XDebug |
||
20 | 9 | Jon Goldberg | |
21 | 14 | Jon Goldberg | #### Web Browser |
22 | 37 | Brienne Kordis | * Install the xdebug extension (e.g. `sudo apt install php8.1-xdebug`). |
23 | * Configure xdebug by copying the values below to `/etc/php/8.1/fpm/conf.d/xdebug.ini`: |
||
24 | 2 | Jon Goldberg | |
25 | 1 | Jon Goldberg | ``` |
26 | 12 | Jon Goldberg | xdebug.mode=debug,develop |
27 | xdebug.start_with_request=trigger |
||
28 | 1 | Jon Goldberg | xdebug.client_host = "127.0.0.1" |
29 | 10 | Jon Goldberg | xdebug.log=/var/log/xdebug.log |
30 | 12 | Jon Goldberg | #xdebug.mode=profile |
31 | 1 | Jon Goldberg | #xdebug.output_dir = "/home/jon/temp/xdebug" |
32 | ``` |
||
33 | 14 | Jon Goldberg | |
34 | 1 | Jon Goldberg | * Install a plugin for your browser, like "XDebug Helper for Firefox". |
35 | 14 | Jon Goldberg | * In the plugin's configuration, set the IDE key to `VSCODE`. |
36 | 37 | Brienne Kordis | * For buildkit sites, you'll need to cp the `xdebug.ini` into `apache2/fpm/conf.d` and `cli/fpm/conf.8`. Then restart apache and php |
37 | 14 | Jon Goldberg | |
38 | 22 | Brienne Kordis | * If one does not already exist, create a launch.json file within the .vscode folder (make a new folder if it does not yet exist) at the root of your codebase. What goes into the launch.json file depends on whether you are debugging a a site created with the `civibuild` command or one that was not built with that command. Here are examples of a [civibuild launch.json](https://hq.megaphonetech.com/projects/commons/wiki/Launchjson_for_civibuild_sites) and a [non-civibuild launch.json](https://hq.megaphonetech.com/projects/commons/wiki/Launchjson_for_non-civibuild_sites). Note that the "max-depth" on the "Listen for XDebug" configuration can be changed to delve deeper into the values that are returned (i.e. a depth of 6 will return more levels of a nested array than a depth of 3). |
39 | 19 | Brienne Kordis | |
40 | 14 | Jon Goldberg | To debug, you must turn on the debugger in VS Code, then enable debugging in the address bar for the requests in question. |
41 | |||
42 | 28 | Jon Goldberg | #### Web Browser - remote debugging |
43 | To debug on a remote server, ensure you have local debugging working first. |
||
44 | |||
45 | #### Server-side setup |
||
46 | * `sudo apt install php{{php_version}}-xdebug` (I should add this to `group_vars/all.yml` so it's everywhere). |
||
47 | 39 | Jon Goldberg | * Create a file `/etc/php/{{php_version}}/fpm/conf.d/xdebug.ini: |
48 | 28 | Jon Goldberg | |
49 | ``` |
||
50 | xdebug.mode=debug |
||
51 | xdebug.start_with_request=trigger |
||
52 | ``` |
||
53 | * Restart PHP. |
||
54 | |||
55 | #### Client side setup |
||
56 | 43 | Jon Goldberg | ##### First time ever remote debugging setup |
57 | 40 | Jon Goldberg | * In your VS Code plugins screen, install the "Remote - SSH" plugin. |
58 | 43 | Jon Goldberg | |
59 | 40 | Jon Goldberg | ##### Always |
60 | 43 | Jon Goldberg | * Using the new **Remote Explorer** sidebar icon in VS Code, select the server you'd like to connect to. Click the "Connect in current window" icon. |
61 | 28 | Jon Goldberg | * If you've already debugged on this site before, you should be able to expand the server and see a workspace file (see screenshot below). Click one of the connect icons. |
62 | * If you haven't debugged on this site before, follow *First Time* instructions below. Otherwise, debug as normal (make sure your Firefox "debug" icon is turned on). |
||
63 | 1 | Jon Goldberg | |
64 | 28 | Jon Goldberg | ##### First Time |
65 | * Click **Open Folder** and navigate to the site's gitroot (usually the same as webroot, but for D8+ it's the folder above `web` so you can also debug in `vendor`). |
||
66 | * Select **File menu » Save Workspace As** and store a workspace file in your home directory. |
||
67 | 43 | Jon Goldberg | * In your VS Code plugins screen, you need to select `Install in SSH` for the `PHP Debug` and `PHP Intelephense` plugins. Make sure it's the "PHP Debug" by XDebug (should have 10M+ installs) |
68 | 29 | Jon Goldberg | * For Drupal sites, also **Install in SSH** the *Drupal Syntax Highlighting* extension or you can't debug .module files. |
69 | 41 | Jon Goldberg | * Go to the VS Code "debug" sidebar. Click **Add Configuration** and then select **workspace**, then **PHP**. |
70 | 28 | Jon Goldberg | * (Optional) in the **Remote Explorer** sidebar, under the server you're connected to, right-click the entry that doesn't say "Workspace" in it and select **Remove from Recent List** to only keep workspace entries. |
71 | |||
72 | 18 | Jon Goldberg | #### civicrm-buildkit (mod_php) |
73 | The instructions above assume php-fpm. To also debug mod_php (e.g. civicrm-buildkit), do the following: |
||
74 | * Use the same configuration file as under "Web Browser", but at `/etc/php/7.4/apache2/conf.d/xdebug.ini`. |
||
75 | * Edit `/etc/php/7.4/apache2/conf.d/xdebug.ini` and change the client port from `9000` to `9001`. |
||
76 | |||
77 | 14 | Jon Goldberg | #### Command Line (phpunit) |
78 | |||
79 | 1 | Jon Goldberg | * You need to have XDebug otherwise configured for CLI. Use the same configuration file as under "Web Browser", but at `/etc/php/7.4/cli/conf.d/xdebug.ini`. |
80 | 15 | Jon Goldberg | * Also change `xdebug.mode=debug,develop` to avoid some unnecessary warning noise. |
81 | 14 | Jon Goldberg | |
82 | 5 | Jon Goldberg | * You need to start a debugging session in VS Code with "Listen for XDebug". |
83 | 1 | Jon Goldberg | * Depending on your VS Code setup, you may need to listen on a different port (I can use the same port for FPM but not mod_php). |
84 | 2 | Jon Goldberg | |
85 | Once you've got all that: |
||
86 | 1 | Jon Goldberg | ```shell |
87 | 15 | Jon Goldberg | env CIVICRM_UF=UnitTests XDEBUG_SESSION=VSCODE phpunit7 /home/jon/local/civicrm-buildkit/build/dmaster/web/sites/all/modules/civicrm/tests/phpunit/CRM/Core/BAO/ActionScheduleTest.php --filter testMembershipJoinDateMinutesUnit |
88 | 2 | Jon Goldberg | ``` |
89 | 6 | Jon Goldberg | |
90 | 30 | Jon Goldberg | #### phpunit for extensions: |
91 | This is for core extensions, I'll figure out (again) non-core extensions later. But from your civiroot: |
||
92 | ```shell |
||
93 | CIVICRM_UF=UnitTests phpunit8 --bootstrap ext/afform/mock/tests/phpunit/bootstrap.php ext/afform/mock/tests/phpunit/api/v4/AfformContactUsageTest.php |
||
94 | ``` |
||
95 | |||
96 | 31 | Jon Goldberg | For non-core extensions, from the extension's root folder. Note the use of `env XDEBUG_SESSION=VSCODE` for step debugging, and `--filter` to limit the tests run. |
97 | ``` |
||
98 | env XDEBUG_SESSION=VSCODE CIVICRM_UF=UnitTests phpunit8 --bootstrap tests/phpunit/bootstrap.php tests/phpunit/api/v3/Cdntaxreceipts/GenerateTest.php --filter testGenerate |
||
99 | ``` |
||
100 | |||
101 | 8 | Jon Goldberg | ### Command-line runs of standalone scripts |
102 | 6 | Jon Goldberg | ```shell |
103 | 13 | Jon Goldberg | env XDEBUG_SESSION=VSCODE php myscript.php |
104 | 6 | Jon Goldberg | ``` |
105 | 38 | Jon Goldberg | Also works for `cv`, probably `drush` and `wp` too: |
106 | ```shell |
||
107 | env XDEBUG_SESSION=VSCODE cv api NotificationLog.retry system_log_id=147597 |
||
108 | ``` |
||
109 | 16 | Jon Goldberg | |
110 | ### Debugging REST API calls in Ansible/curl |
||
111 | 17 | Jon Goldberg | Add an additional POST argument `XDEBUG_SESSION=VSCODE`. In curl, just add `-d 'XDEBUG_SESSION=VSCODE'` anywhere in your command. |
112 | |||
113 | For Ansible, this might look like: |
||
114 | 16 | Jon Goldberg | |
115 | ```yaml |
||
116 | - name: Shut up about Civi extensions (warnings only, 7 days) |
||
117 | uri: |
||
118 | url: "{{ primary_url }}/{{ endpoint }}" |
||
119 | method: POST |
||
120 | body: |
||
121 | XDEBUG_SESSION: VSCODE |
||
122 | entity: StatusPreference |
||
123 | action: create |
||
124 | json: "{{ {'name': 'checkExtensionsUpdates', 'ignore_severity': 3, 'hush_until': seven_days_hence } | to_json }}" |
||
125 | api_key: "{{ crm_api_key }}" |
||
126 | key: "{{ crm_site_key }}" |
||
127 | body_format: form-urlencoded |
||
128 | return_content: yes |
||
129 | ``` |
||
130 | 23 | Jon Goldberg | |
131 | ### Debugging in PHP `file_get_contents()` (e.g. `check_civicrm.php`) |
||
132 | Add `XDEBUG_SESSION=VSCODE` as a `GET` argument, it works even on a `POST` request. Pairs well with a remote debugging session. |
||
133 | e.g.: |
||
134 | ```php |
||
135 | $url = "$prot://$host_address/$path/System/check?XDEBUG_SESSION=VSCODE"; |
||
136 | ``` |
||
137 | 24 | Brienne Kordis | |
138 | ### Debugging JavaScript |
||
139 | |||
140 | While you can open up the Developer Tools on a browser (by right clicking on the window and then clicking **Inspect**) and debug the code directly there, it might be preferable to set up a debugging environment within an IDE, i.e. Visual Studio Code. To do so: |
||
141 | |||
142 | 27 | Brienne Kordis | 1. Open up your launch.json file (Need to set one up? There are [non-civibuild](https://hq.megaphonetech.com/projects/commons/wiki/Launchjson_for_non-civibuild_sites) and [Civibuild](https://hq.megaphonetech.com/projects/commons/wiki/Launchjson_for_civibuild_sites) options) |
143 | 24 | Brienne Kordis | 1. Within the `”configurations:”` array, add a comma after the last curly brace and then paste in: |
144 | |||
145 | ``` json |
||
146 | { |
||
147 | "type": "msedge", |
||
148 | "request": "attach", |
||
149 | "name": "Attach to browser", |
||
150 | "port": 9222 |
||
151 | } |
||
152 | ``` |
||
153 | * If you’d prefer to debug on chrome, use `”type”: “chrome”` |
||
154 | 1. Within your terminal, run the following command: |
||
155 | |||
156 | ```bash |
||
157 | 26 | Brienne Kordis | /usr/bin/google-chrome --remote-debugging-port=9222 –user-data-dir=remote-debug-profile |
158 | 24 | Brienne Kordis | ``` |
159 | * `/usr/bin/google-chrome` is the path of the Google Chrome Binary on Linux. For other operating systems, check out this [comment](https://forum.katalon.com/t/unknown-error-cannot-find-chrome-binary/9008/5), but note that the exact name might be different (i.e. google-chrome1 vs google-chrome). You can always `cd` through the path it recommends to find the exact match for either Chrome or MSEdge. |
||
160 | |||
161 | 1. Within VS Code, go to the Run and Debug tab, and from the drop down menu at the top, select “Attach to browser” and start the debugger. |
||
162 | * Note that the command given in the previous step is configured to open up a new browser, but these arguments (and more) can be customized. See the [documentation](https://code.visualstudio.com/docs/nodejs/browser-debugging#_launch-configuration-attributes) |
||
163 | |||
164 | 1. The new browser window (or tab, depending on your settings) is now configured to be the debuggee-yes, that’s the technical term- so you can set breakpoints and debug within VS Code! |
||
165 | 32 | Jon Goldberg | |
166 | ### Running Drupal 9+ tests |
||
167 | The [Mink setup](https://docs.civicrm.org/dev/en/latest/testing/mink/) instructions worked quite well. |
||
168 | I then also ran: |
||
169 | ``` |
||
170 | composer require drupal/webform |
||
171 | composer require drupal/webform_civicrm |
||
172 | 33 | Jon Goldberg | composer require drupal/token |
173 | 32 | Jon Goldberg | composer require semperit/minkcivicrmhelpers |
174 | ``` |
||
175 | 33 | Jon Goldberg | |
176 | Looking at CiviCARROT logs on the Webform-CiviCRM Github was helpful to figure those out. |
||
177 | 34 | Jon Goldberg | |
178 | For permissions reasons, you have to run as the www-data user (this is set up with `mod_php`, not `php-fpm`): |
||
179 | ```shell |
||
180 | 44 | Jon Goldberg | zabuntu: ~/local/wfc-testing/web/core » sudo -u www-data ../../vendor/bin/phpunit -c $HOME/local/wfc-testing/phpunit.xml ../modules/contrib/webform_civicrm/tests/src/FunctionalJavascript/ContributionPayLaterTest.php --filter testSubmitContribution |
181 | 34 | Jon Goldberg | ``` |
182 | 35 | Brienne Kordis | |
183 | ### Finding an entry point to debug |
||
184 | If a better one can't be found in an error log/message, use these steps to start debugging: |
||
185 | 1. ssh into the server |
||
186 | 1. change to root user |
||
187 | 1. `cd /var/log/apache2` |
||
188 | 36 | Brienne Kordis | 1. `nano other_vhosts_access.log` |
189 | 35 | Brienne Kordis | 1. search for your IP address ( you can type "What's my IP address?" into Google if you don't know it) |
190 | 1. find the relevant line(s) with your IP address and grab the civicrm path from the url |
||
191 | 1. open up mysql (`cv sql`) and run `select * from civicrm_menu where path = '[civicrm path]';` |
||
192 | 36 | Brienne Kordis | 1. look at the access arguments, but we care most about the `page_callback` column which lists the civicrm class that is loaded at that path |
193 | 35 | Brienne Kordis | 1. open up that class in the codebase and use the buildForm hook as the entry point for debugging |